The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Automation Bias in AI-Decision Support: Results from an Empirical Study
Open accessAbstract
INTRODUCTION: Automation bias poses a significant challenge to the effectiveness of Clinical Decision Support Systems (CDSS), potentially compromising diagnostic accuracy. Previous research highlights trust, self-confidence, and task difficulty as key determinants. With the increasing availability of AI-enabled CDSS, automation bias attains new attention. This study therefore aims to identify factors influencing automation bias in a diagnostic task. METHODS: A quantitative intervention study with participants from different backgrounds (n = 210) was conducted, employing regression analysis to analyze potential factors. Automation bias was measured as the agreement rate with wrong AI-enabled recommendations. RESULTS AND DISCUSSION: Diagnostic performance, certified wound care training, physician profession, and female gender significantly reduced false agreement rates. Higher perceived benefit of the system was significantly associated with promoting false agreement. Strategies like comprehensive diagnostic training are pivotal in the prevention of automation bias when implementing CDSS. CONCLUSION: Considering factors influencing automation bias when introducing a CDSS is critical to fully leverage the benefits of such a system. This study highlights that non-specialists, who stand to gain the most from CDSS, are also the most susceptible to automation bias, emphasizing the need for specialized training to mitigate this risk and ensure diagnostic accuracy and patient safety.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Complementary work on alert fatigue and automation bias shows that clinician interaction with decision support systems can recursively influence both inputs and outcomes, creating feedback loops that invalidate original performance assumptions [19,20].”
From Validation is not enough: Longitudinal evidence of post-deployment fragility in clinical AI systems (2026) · cites this paper as [19]
In the citing paper
“Research shows that assertive, polished output encourages uncritical acceptance-even in cases of clear error or contradiction (Horowitz and Kahn, 2023;Kutza et al., 2024).”
From Epistemic authority and generative AI in learning spaces: rethinking knowledge in the algorithmic age (2025) · cites this paper as Kutza et al., 2024
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Exploring automation bias in human–AI collaboration: a review and implications for explainable AI
Romeo, G., & Conti, D. (2026) · AI & SOCIETY · doi:10.1007/s00146-025-02422-7 · Cited by 209
“Kücking et al. (2024) analyzed wound assessment in 210 professionals (63.3% nurses, 36.7% physicians) using AI-enabled Clinical Decision Support Systems.”
InfluentialJose, B., Cleetus, A., Joseph, B., Joseph, L., Jose, B., & John, A. K. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1647687 · Cited by 63
Impact of AI recommendation correctness on diagnostic accuracy in clinical decision-making
Kücking, F., Busch, D., Przysucha, M., Kutza, J.-O., Hannemann, N., Hüsers, J., Babitsch, B., & Hübner, U. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.106223 · Cited by 42
Self-citationPrescribing the Future: The Role of Artificial Intelligence in Pharmacy
Allam, H. (2025) · Information · doi:10.3390/info16020131 · Cited by 48
Mache, S., Bernburg, M., Würtenberger, A., & Groneberg, D. A. (2025) · Clinics and Practice · doi:10.3390/clinpract15080138 · Cited by 30
Learning against the machine: the double edged sword of (Gen)AI in STEM education
Wulff, P., & Kubsch, M. (2025) · International Journal of STEM Education · doi:10.1186/s40594-025-00588-6 · Cited by 23
“More often than not, learners as well as instructors tend to trust GenAI outputs (automation bias, magical thinking, anthropomorphizing GenAI) (Kücking et al., 2024; Mitchell, 2025a).”
Kücking, F., Hübner, U., & Busch, D. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf116 · Cited by 9
“45,46 This emphasizes the importance of reliable AI systems and high-quality ground truth, especially in areas like wound diagnostics, where ground truth labels heavily rely on clinical expertise.”
Self-citationBencardino, S., Lodola, I., Centanni, L., Mandarino, F. V., Fanizza, J., Furfaro, F., D’Amico, F., Fuccio, L., Bruni, A., Facciorusso, A., et al. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2025.1719145 · Cited by 20
Behavioral Impacts of AI Reliance in Diagnostics: Balancing Automation with Skill Retention
Sunday, O. (2025) · Epidemiology and Health Data Insights · doi:10.63946/ehdi/16894 · Cited by 7
Toward Safer Diagnoses: A SEIPS-Based Narrative Review of Diagnostic Errors
Yen, C., Epling, J. W., Rockwell, M., & Vaughn-Cooke, M. (2026) · Diagnostics · doi:10.3390/diagnostics16020347 · Cited by 6
Kuhl, U., & Bush, A. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-08333-3_12 · Cited by 12
“This finding extends research on automation bias, leading professionals to defer to AI suggestions even when these conflict with their own judgment [18], and demonstrates transmission of algorithmic biases to human decision-makers.”
InfluentialNurses’ experiences regarding role boundaries in collaborative AI-Assisted nursing: A meta-synthesis
Zhang, Z., Hou, J., Xu, C., Li, H., & Wan, H. (2026) · Social Science & Medicine · doi:10.1016/j.socscimed.2026.119385 · Cited by 3
Validation is not enough: Longitudinal evidence of post-deployment fragility in clinical AI systems
Kopanitsa, G. (2026) · PLOS Digital Health · doi:10.1371/journal.pdig.0001534 · Cited by 9
“Complementary work on alert fatigue and automation bias shows that clinician interaction with decision support systems can recursively influence both inputs and outcomes, creating feedback loops that invalidate original performance assumptions [19,20].”
Arévalo-Royo, J., Montalvo, F. J. F., Latorre‐Biel, J., Macías, E. J., Martínez, E., & Blanco‐Fernández, J. (2025) · Applied Sciences · doi:10.3390/app152010913 · Cited by 3
Wei, Y., Li, Y., Hu, W., Kang, J., Han, Z. Y., Zhen, M., & Wang, C. (2026) · Frontiers in Oral Health · doi:10.3389/froh.2026.1741033 · Cited by 2
Why public procurement professionals accept (or resist) generative AI: a qualitative study
Tahtali, M. A., Blanc, P. M. L., Dirne, C., & Snijders, C. C. P. (2026) · Journal of Public Procurement · doi:10.1108/jopp-09-2025-0110 · Cited by 2
Wu, F., Aseem, R., Armes, J., Rockall, T., Frampton, A. E., & Pakzad, F. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1804004 · Cited by 2
“Kücking et al. (2024) investigated automation bias in a study in which healthcare professionals diagnosed wound-healing complications using an AI-based CDSS that provided diagnostic suggestions.”
Shimelash, N., Rutunda, S., Menon, V., Emmanuel-Fabula, M., Uwimbabazi, A., Rugege, C., Nshimiyimana, C., Rwema, I. S., Kandekwe, M., Berhe, D. F., et al. (2026) · medRxiv · doi:10.64898/2026.02.16.26346409 · Cited by 1
Naye, F., Ouellet, S., Yousefi, F., Cachinho, C., Bergeron, F., Bhattacharyya, O. K., Stamenova, V., & Sasseville, M. (2026) · doi:10.2196/preprints.96882 · Cited by 1
Entscheidungsunterstützungssysteme – der Weg zu mehr Evidenz am Patientenbett?
Kücking, F. (2025) · intensiv · doi:10.1055/a-2442-4985
Self-citationBuilding an Interdisciplinary Centre for AI Education: Strategy and Practice
Midroni, J., Postill, G., Moturu, A., Haque, N., & Rosella, L. C. (2026) · University of Toronto Medical Journal · doi:10.33137/utmj.v103i1.46175
Introduction: Implementation of Artificial Intelligence for Improving Healthcare
Hübner, U. H., Rubeis, G., Delaney, C. W., & Ball, M. J. (2026) · Health informatics · doi:10.1007/978-3-032-11938-4_1
Self-citationHuman Intelligence and the Caring Imperative
Hübner, U. H. (2026) · Health informatics · doi:10.1007/978-3-032-11938-4_3
Self-citationSchulz, C., Zwaan, L., Wakkee, M., & Staal, J. (2026) · doi:10.2196/preprints.91512
Grosser, J., Sauerbach, J., Borgstedt, R., Rehberg, S. W., & Düvel, J. (2026) · doi:10.2196/preprints.93035
Ontological Foundations for Deterministic Assurance Context Construction and Governed AI Reasoning
Wen, S.-F. (2026) · Applied Sciences · doi:10.3390/app16041984
OpenEvidence clinical question-answering platform: systematic review of early evaluations
Artsi, Y., Sorin, V., Glicksberg, B. S., Freeman, R., Korfiatis, P. D., Bratt, A. K., Nadkarni, G. N., & Klang, E. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-03077-4 · Cited by 2
Haas, M., Rinderknecht, E., May, M., Burger, M., Gilfrich, C. P., Herrmann, A., Brookman-May, S. D., Eckl, C., Kruschwitz, U., Ateia, S., et al. (2026) · doi:10.2196/preprints.96886
Gao, C.-M., Fu, P., Du, W., & Li, Y. S. (2026) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2026.1774181
Research Automation in Healthcare: Scoping Review with ☸️SAIMSARA
SAIMSARA (2026) · SAIMSARA Journal · doi:10.62487/saimsaraed91d2be
Kokoszka, M., Chodór, M., Kuczkowska, J. M., Bordakiewicz, J., Michalska, Z., Pokorska, D., Świechowska, J., Zarzycka, Z., Samberger, I., & Wiciak, M. (2026) · International Journal of Innovative Technologies in Social Science · doi:10.31435/ijitss.1(49).2026.4963
“This phenomenon is defined as the human tendency to over-rely on automated outputs, often at the expense of actively seeking information or evaluating uncertainty[26,27].”
Agentic AI and the Algorithm of Good
Gounaris, A., & Kosteletos, G. (2026) · AI · doi:10.3390/ai7090352
Grosser, J., Sauerbach, J., Borgstedt, R., Rehberg, S. W., & Düvel, J. (2026) · JMIR Formative Research · doi:10.2196/93035
“Studies demonstrate that clinicians can exhibit automation bias when they are inclined to follow erroneous AI recommendations and that task context, time pressure, and confidence in the system can influence this effect [24,25].”
Şeremet, G. G. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-6650-0.ch001
Nurfadhilah, E., Aini, L. R., Santosa, A., Uliniansyah, M. T., Gunarso, G., Putra, P. K., Pebiana, S., Fajri, R., Hidayati, N. N., Prastowo, R. D., et al. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-7862-6.ch003
From appraisal to deployment: A governance framework for large language models in emergency medicine
Aykut, A. (2026) · Artificial Intelligence in Emergency Medicine · doi:10.1016/j.aiemed.2026.100029
Governing AI reasoning to mitigate assumption injection in assurance workflows
Wen, S.-F. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01813-z
Artificial Intelligence Technologies Supporting Clinical Judgement in Nursing: A Scoping Review
Alves, J., de Azevedo, R. M., Encarnação, R., Pais-Vieira, C., & Alves, P. J. P. (2026) · Journal of Advanced Nursing · doi:10.1111/jan.70670 · Cited by 2
Naye, F., Ouellet, S., Yousefi, F., Cachinho, C., Bergeron, F., Bhattacharyya, O. K., Stamenova, V., & Sasseville, M. (2026) · Journal of Medical Internet Research · doi:10.2196/96882 · Cited by 2
Šurdilović, D., Shetty, R. M., Azim, S. A., Awadalkreem, F., & Siriwardena, B. S. M. S. (2026) · Research Square · doi:10.21203/rs.3.rs-10208256/v1
Tajima, H. (2026) · JMIR Nursing · doi:10.2196/99590
“…decisions that were sensitive to whether the AI recommendation was correct or incorrect [16], and a related report measuring the rate of agreement with incorrect recommendations found that higher diagnostic performance and certified wound-care training were associated with lower agreement [33].”
Devarajan, Y., Acharya, S. K., Jakhar, S. K., Nagappan, B., Saxena, S. A., Naik, Y., Jayabal, R., & Mehar, K. (2026) · IET Cyber-Physical Systems Theory & Applications · doi:10.1049/cps2.70062 · Cited by 3
Bekele, W. S. (2026) · Research Square · doi:10.21203/rs.3.rs-10630810/v1
Masood, H., Bajwa, M. N., Shafait, S., Fraz, M. M., Faisal Shafait, B., & Khan, H. A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-35390-0_6
The efficiency–verification trade-off in large language model-assisted workplace risk assessment
Bosler, A., Koppel, T., & Reinhold, K. (2026) · Proceedings of the Estonian Academy of Sciences · doi:10.3176/proc.2026.3.10
Haas, M., Rinderknecht, E., May, M., Burger, M., Gilfrich, C. P., Herrmann, A., Brookman-May, S. D., Eckl, C., Kruschwitz, U., Ateia, S., et al. (2026) · Journal of Medical Internet Research · doi:10.2196/96886
Liu, Y., Han, L., Che, L., Dong, W., Zhang, T., & Guo, H. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1867722 · Cited by 2
“Non-specialists and junior trainees demonstrate higher rates of false agreement with incorrect AI outputs (18).”
Sebin, B., & Sebin, I. K. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1956533
Artificial Intelligence in Medicine: Current Threats, Risk Dimensions and Future Challenges
Koshiya, H. R., Gehlawat, M., Girdhar, S., & Kumar, P. (2026) · IntechOpen eBooks · doi:10.5772/intechopen.1017724
Beyond the Black Box: A Point-Of-Care Framework for LLM Literacy and Critical Appraisal
Stephenson, C. R., Aakre, C. A., Croghan, I. T., Hurt, R. T., & West, C. P. (2026) · Journal of Primary Care & Community Health · doi:10.1177/21501319261491056
When prediction becomes prescription: AI, risk, and the humanistic right to moral deliberation
Waitzman, R. (2026) · Medicine Health Care and Philosophy · doi:10.1007/s11019-026-10399-3
Капустник, В. В. (2026) · Access to Justice in Eastern Europe · doi:10.33327/ajee-18-9.4-a0002009
Metadata
- Authors
- Kücking, F., Hübner, U., Przysucha, M., Hannemann, N., Kutza, J.-O., Moelleken, M., Erfurt-Berge, C., Dissemond, J., Babitsch, B., & Busch, D.
- Affiliations
- Hochschule Osnabrück (DE)
- Osnabrück University (DE)
- Essen University Hospital (DE)
- Friedrich-Alexander-Universität Erlangen-Nürnberg (DE)
- ORCID
- Venue
- Studies in Health Technology and Informatics
- Publisher
- IOS Press
- Published
- 2024-08-30
- Volume
- 317
- Pages
- 298-304
- ISSN
- 0926-9630 (ISSN-L)
- 1879-8365
- OpenAlex
- W4402279236
- Cited by
- 51
- References
- 0
- Citations by year
- 2026: 40 · 2025: 11
- FWCI
- 22.42
- Type
- book chapter
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Studies in health technology and informatics (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Library Osnabrück University (Hochschule Osnabrück) (submittedVersion, cc-by-nc)
- Funders
- Bundesministerium für Bildung und Forschung (16SV8616)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- automation bias, clinical decision support systems, AI-enabled decision support, diagnostic accuracy, trust in AI, wound care training, diagnostic training, physician profession, gender differences, patient safety, non-expert users
- MeSH terms
- Artificial Intelligence, Automation, Female, Humans, Male, Bias, Decision Support Systems, Clinical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.