CoChat

Perceived Trust and Professional Identity Threat in AI-Based Clinical Decision Support Systems: Scenario-Based Experimental Study on AI Process Design Features

Open access
Ackerhans, Sophia, Wehkamp, Kai, Petzina, Rainer, Dumitrescu, Daniel, Schultz, Carsten · 2025 · JMIR Formative Research

The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.

Abstract

Background: Artificial intelligence (AI)–based systems in medicine like clinical decision support systems (CDSSs) have shown promising results in health care, sometimes outperforming human specialists. However, the integration of AI may challenge medical professionals’ identities and lead to limited trust in technology, resulting in health care professionals rejecting AI-based systems. Objective: This study aims to explore the impact of AI process design features on physicians’ trust in the AI solution and on perceived threats to their professional identity. These design features involve the explainability of AI-based CDSS decision outcomes, the integration depth of the AI-generated advice into the clinical workflow, and the physician’s accountability for the AI system-induced medical decisions. Methods: We conducted a 3-factorial web-based between-subject scenario-based experiment with 292 medical students in their medical training and experienced physicians across different specialties. The participants were presented with an AI-based CDSS for sepsis prediction and prevention for use in a hospital. Each participant was given a scenario in which the 3 design features of the AI-based CDSS were manipulated in a 2×2×2 factorial design. SPSS PROCESS (IBM Corp) macro was used for hypothesis testing. Results: The results suggest that the explainability of the AI-based CDSS was positively associated with both trust in the AI system (β=.508; P<.001) and professional identity threat perceptions (β=.351; P=.02). Trust in the AI system was found to be negatively related to professional identity threat perceptions (β=–.138; P=.047), indicating a partially mediated effect on professional identity threat through trust. Deep integration of AI-generated advice into the clinical workflow was positively associated with trust in the system (β=.262; P=.009). The accountability of the AI-based decisions, that is, the system required a signature, was found to be positively associated with professional identity threat perceptions among the respondents (β=.339; P=.004). Conclusions: Our research highlights the role of process design features of AI systems used in medicine in shaping professional identity perceptions, mediated through increased trust in AI. An explainable AI-based CDSS and an AI-generated system advice, which is deeply integrated into the clinical workflow, reinforce trust, thereby mitigating perceived professional identity threats. However, explainable AI and individual accountability of the system directly exacerbate threat perceptions. Our findings illustrate the complex nature of the behavioral patterns of AI in health care and have broader implications for supporting the implementation of AI-based CDSSs in a context where AI systems may impact professional identity.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/64266

Cites

65 of 65 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 The proposed research framework for analyzing the impact of AI process design features on perceived professional identity threat. AI: artificial intelligence; CDSS: clinical decision support system; H1A: hypothesis 1A; H1B: hypothesis 1B; H2A: hypothesis 2A; H2B: hypothesis 2B; H3A: hypothesis 3A; H3B: hypothesis 3B; H4, hypothesis 4.
Figure 1 The proposed research framework for analyzing the impact of AI process design features on perceived professional identity threat. AI: artificial intelligence; CDSS: clinical decision support system; H1A: hypothesis 1A; H1B: hypothesis 1B; H2A: hypothesis 2A; H2B: hypothesis 2B; H3A: hypothesis 3A; H3B: hypothesis 3B; H4, hypothesis 4.CC BY · PubMed Central
Figure 2 Mean values of variable trust in AI-based CDSS, with pairwise comparisons (post hoc results). AI: artificial intelligence; CDSS: clinical decision support system. *P<.05, **P<.01, ***P<.001.
Figure 2 Mean values of variable trust in AI-based CDSS, with pairwise comparisons (post hoc results). AI: artificial intelligence; CDSS: clinical decision support system. *P<.05, **P<.01, ***P<.001.CC BY · PubMed Central
Figure 3 Mean values of variable threat of AI-based CDSS to professional identity, with pairwise comparisons (post hoc results). AI: artificial intelligence; CDSS: clinical decision support system. *P<.05, **P<.01.
Figure 3 Mean values of variable threat of AI-based CDSS to professional identity, with pairwise comparisons (post hoc results). AI: artificial intelligence; CDSS: clinical decision support system. *P<.05, **P<.01.CC BY · PubMed Central
Figure 4 Regression results (N=292). AI: artificial intelligence; CDSS: clinical decision support system; H1A: hypothesis 1A; H1B: hypothesis 1B; H2A: hypothesis 2A; H2B: hypothesis 2B; H3A: hypothesis 3A; H3B: hypothesis 3B; H4, hypothesis 4.
Figure 4 Regression results (N=292). AI: artificial intelligence; CDSS: clinical decision support system; H1A: hypothesis 1A; H1B: hypothesis 1B; H2A: hypothesis 2A; H2B: hypothesis 2B; H3A: hypothesis 3A; H3B: hypothesis 3B; H4, hypothesis 4.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 65 references

Research works printed but not linked: 2

  1. MöhlmannMZalmansonLHands on the wheel: Navigating algorithmic management and uber drivers' autonomy2017International Conference on Information Systems (ICIS 2017)December 10-13, 2017Seoul, South Korea
  2. Nunnally, JC, 1994, Psychometric Theory

Cited by

See all 47

Metadata

Authors
Ackerhans, S., Wehkamp, K., Petzina, R., Dumitrescu, D., & Schultz, C.
Affiliations
  • Christian-Albrechts-Universität zu Kiel (DE)
  • MSH Medical School Hamburg – University of Applied Sciences and Medical University (DE)
  • Bielefeld University (DE)
Corresponding author
Ackerhans, Sophia
Venue
JMIR Formative Research
Published
2025-03-26
Volume
9
Pages
e64266
ISSN
2561-326X (ISSN-L)
OpenAlex
W4408852197
Cited by
38
References
65
Citations by year
2026: 33 · 2025: 5
FWCI
9.08
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Formative Research (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
Keywords
trust in AI, clinical decision support systems, explainable AI, clinical workflow integration, physician accountability, sepsis prediction, AI adoption in healthcare, AI-generated medical advice
MeSH terms
Adult, Artificial Intelligence, Attitude of Health Personnel, Female, Humans, Male, Physicians, Students, Medical, Decision Support Systems, Clinical, Trust, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.