Radiologists’ perspectives on the workflow integration of an artificial intelligence-based computer-aided detection system: A qualitative study
Open accessAbstract
In healthcare, artificial intelligence (AI) is expected to improve work processes, yet most research focuses on the technical features of AI rather than its real-world clinical implementation. To evaluate the implementation process of an AI-based computer-aided detection system (AI-CAD) for prostate MRI readings, we interviewed German radiologists in a pre-post design. We embedded our findings in the Model of Workflow Integration and the Technology Acceptance Model to analyze workflow effects, facilitators, and barriers. The most prominent barriers were: (i) a time delay in the work process, (ii) additional work steps to be taken, and (iii) an unstable performance of the AI-CAD. Most frequently named facilitators were (i) good self-organization, and (ii) good usability of the software. Our results underline the importance of a holistic approach to AI implementation considering the sociotechnical work system and provide valuable insights into key factors of the successful adoption of AI technologies in work systems.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
These findings underscore the value of engaging stakeholders throughout the process.
“These findings underscore the value of engaging stakeholders (e.g., national leadership, network teams, Trust clinical, managerial, and technical staff, and AI suppliers) throughout the process, reflecting previous published research on implementing AI in radiology services.25,26”
From Procurement and early deployment of artificial intelligence tools for chest diagnostics in NHS services in England: a rapid, mixed method evaluation (2025) · cites this paper as [25]
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483 · see citing works
Tong, A., Sainsbury, P., & Craig, J. (2007) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzm042 · Cited by 42,509 · see citing works
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332 · see citing works
Artificial intelligence in radiology
Hosny, A., Parmar, C., Quackenbush, J., Schwartz, L. H., & Aerts, H. J. W. L. (2018) · Nature Reviews Cancer · doi:10.1038/s41568-018-0016-5 · Cited by 3,803 · see citing works
Predicting the future - big data, machine learning, and clinical medicine
Obermeyer, Z., & Emanuel, E. J. (2016) · New England Journal of Medicine · doi:10.1056/nejmp1606181 · Cited by 3,652 · see citing works
Artificial intelligence and the future of work: Human-AI symbiosis in organizational decision making
Jarrahi, M. H. (2018) · Business Horizons · doi:10.1016/j.bushor.2018.03.007 · Cited by 2,772 · see citing works
The Technology Acceptance Model: Its past and its future in health care
Holden, R. J., & Karsh, B.-T. (2010) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.07.002 · Cited by 2,669 · see citing works
The practical implementation of artificial intelligence technologies in medicine
He, J., Baxter, S. L., Xu, J., Xu, J., Zhou, X., & Zhang, K. (2019) · Nature Medicine · doi:10.1038/s41591-018-0307-0 · Cited by 2,246 · see citing works
Work system design for patient safety: the SEIPS model
Carayon, P., Schoofs Hundt, A., Karsh, B.-T., Gurses, A. P., Alvarado, C. J., Smith, M., & Flatley Brennan, P. (2006) · Quality in Health Care · doi:10.1136/qshc.2005.015842 · Cited by 1,795 · see citing works
Holden, R. J., Carayon, P., Gurses, A. P., Hoonakker, P., Hundt, A. S., Ozok, A. A., & Rivera-Rodriguez, A. J. (2013) · Ergonomics · doi:10.1080/00140139.2013.838643 · Cited by 1,221 · see citing works
Artificial Intelligence and Human Trust in Healthcare: Focus on Clinicians
Asan, O., Bayrak, A. E., & Choudhury, A. (2020) · Journal of Medical Internet Research · doi:10.2196/15154 · Cited by 825 · see citing works
Transparency and the black box problem: why we do not trust AI
von Eschenbach, W. J. (2021) · Philosophy & Technology · doi:10.1007/s13347-021-00477-0 · Cited by 786 · see citing works
Human factors systems approach to healthcare quality and patient safety
Carayon, P., Wetterneck, T. B., Rivera-Rodriguez, A. J., Hundt, A. S., Hoonakker, P., Holden, R., & Gürses, A. P. (2013) · Applied Ergonomics · doi:10.1016/j.apergo.2013.04.023 · Cited by 746 · see citing works
Artificial intelligence-enabled healthcare delivery
Reddy, S., Fox, J., & Purohit, M. P. (2019) · Journal of the Royal Society of Medicine · doi:10.1177/0141076818815510 · Cited by 635 · see citing works
Artificial intelligence in healthcare: An essential guide for health leaders
Chen, M., & Decary, M. (2020) · Healthcare Management Forum · doi:10.1177/0840470419873123 · Cited by 538 · see citing works
Artificial intelligence: Implications for the future of work
Howard, J. (2019) · American Journal of Industrial Medicine · doi:10.1002/ajim.23037 · Cited by 522 · see citing works
Hawaii international conference on system sciences
Schultz, E. (1992) · ACM SIGCHI Bulletin · doi:10.1145/134421.134436 · Cited by 518 · see citing works
Use of AI-based tools for healthcare purposes: a survey study from consumers’ perspectives
Esmaeilzadeh, P. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01191-1 · Cited by 507 · see citing works
Wang, W., & Siau, K. (2019) · Journal of Database Management · doi:10.4018/jdm.2019010104 · Cited by 452 · see citing works
Role of Artificial Intelligence Applications in Real-Life Clinical Practice: Systematic Review
Yin, J., Ngiam, K. Y., & Teo, H. H. (2021) · Journal of Medical Internet Research · doi:10.2196/25759 · Cited by 419 · see citing works
Will artificial intelligence solve the human resource crisis in healthcare?
Meskó, B., Hetényi, G., & Győrffy, Z. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3359-4 · Cited by 360 · see citing works
The potential of artificial intelligence to improve patient safety: a scoping review
Bates, D. W., Levine, D. M., Syrowatka, A., Kuznetsova, M., Craig, K. J. T., Rui, A., Jackson, G. P., & Rhee, K. B. L. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00423-6 · Cited by 351 · see citing works
Strohm, L., Hehakaya, C., Ranschaert, E. R., Boon, W. P. C., & Moors, E. H. M. (2020) · European Radiology · doi:10.1007/s00330-020-06946-y · Cited by 329 · see citing works
Ahmad, Z., Rahim, S., Zubair, M., & Abdul-Ghafar, J. (2021) · Diagnostic Pathology · doi:10.1186/s13000-021-01085-4 · Cited by 293 · see citing works
Sezgın, E. (2023) · Digital Health · doi:10.1177/20552076231186520 · Cited by 279 · see citing works
Will Artificial Intelligence Replace Radiologists?
Langlotz, C. P. (2019) · Radiology Artificial Intelligence · doi:10.1148/ryai.2019190058 · Cited by 254 · see citing works
How does artificial intelligence in radiology improve efficiency and health outcomes?
van Leeuwen, K. G., de Rooij, M., Schalekamp, S., van Ginneken, B., & Rutten, M. J. C. M. (2022) · Pediatric Radiology · doi:10.1007/s00247-021-05114-8 · Cited by 236 · see citing works
The DECIDE-AI Steering Group (2021) · Nature Medicine · doi:10.1038/s41591-021-01229-5 · Cited by 184 · see citing works
What we talk about when we talk about trust: Theory of trust for AI in healthcare
Gille, F., Jobin, A., & Ienca, M. (2020) · Intelligence-Based Medicine · doi:10.1016/j.ibmed.2020.100001 · Cited by 159 · see citing works
Developing a delivery science for artificial intelligence in healthcare
Li, R. C., Asch, S., & Shah, N. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00318-y · Cited by 159 · see citing works
The End of Radiology? Three Threats to the Future Practice of Radiology
Chockley, K., & Emanuel, E. (2016) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2016.07.010 · Cited by 139 · see citing works
Abell, B., Naicker, S., Rodwell, D., Donovan, T., Tariq, A., Baysari, M., Blythe, R., Parsons, R., & McPhail, S. M. (2023) · Implementation Science · doi:10.1186/s13012-023-01287-y · Cited by 131 · see citing works
Artificial Intelligence, Jobs and the Future of Work: Racing with the Machines
Bruun, E. P. G., & Duka, A. (2018) · Basic Income Studies · doi:10.1515/bis-2018-0018 · Cited by 125 · see citing works
Research Trends in Artificial Intelligence Applications in Human Factors Health Care: Mapping Review
Asan, O., & Choudhury, A. (2021) · JMIR Human Factors · doi:10.2196/28236 · Cited by 114 · see citing works
Salwei, M. E., & Carayon, P. (2022) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/15553434221097357 · Cited by 112 · see citing works
Success Factors of Artificial Intelligence Implementation in Healthcare
Wolff, J., Pauling, J., Keck, A., & Baumbach, J. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.594971 · Cited by 104 · see citing works
Twilt, J. J., van Leeuwen, K. G., Huisman, H. J., Fütterer, J. J., & de Rooij, M. (2021) · Diagnostics · doi:10.3390/diagnostics11060959 · Cited by 97 · see citing works
Holden, R. J. (2011) · Journal of Patient Safety · doi:10.1097/pts.0b013e3182388cfa · Cited by 95 · see citing works
Ferretti, A., Schneider, M., & Blasimme, A. (2018) · European Data Protection Law Review · doi:10.21552/edpl/2018/3/10 · Cited by 79 · see citing works
Sunoqrot, M. R. S., Saha, A., Hosseinzadeh, M., Elschot, M., & Huisman, H. (2022) · European Radiology Experimental · doi:10.1186/s41747-022-00288-8 · Cited by 76 · see citing works
Human-AI Collaboration in Healthcare: A Review and Research Agenda
Lai, Y., Kankanhalli, A., & Ong, D. (2021) · Hawaii International Conference on System Sciences · doi:10.24251/hicss.2021.046 · Cited by 69 · see citing works
Salwei, M. E., Carayon, P., Hoonakker, P., Hundt, A. S., Wiegmann, D. A., Pulia, M. S., & Patterson, B. W. (2021) · Applied Ergonomics · doi:10.1016/j.apergo.2021.103498 · Cited by 69 · see citing works
Deep learning-based artificial intelligence applications in prostate MRI: brief summary
Türkbey, B., & Haider, M. A. (2021) · British Journal of Radiology · doi:10.1259/bjr.20210563 · Cited by 66 · see citing works
Felmingham, C. M., Adler, N. R., Ge, Z., Morton, R. L., Janda, M., & Mar, V. J. (2021) · American Journal of Clinical Dermatology · doi:10.1007/s40257-020-00574-4 · Cited by 57 · see citing works
Wenderott, K., Krups, J., Luetkens, J. A., Gambashidze, N., & Weigl, M. (2023) · European Journal of Radiology · doi:10.1016/j.ejrad.2023.111252 · Cited by 40 · see citing works
Self-citationRadiomics for personalised medicine: the long road ahead
Miles, K. A. (2020) · British Journal of Cancer · doi:10.1038/s41416-019-0699-8 · Cited by 33 · see citing works
Forookhi, A., Laschena, L., Pecoraro, M., Borrelli, A., Massaro, M., Dehghanpour, A., Cipollari, S., Catalano, C., & Panebianco, V. (2023) · European Journal of Radiology · doi:10.1016/j.ejrad.2023.110749 · Cited by 32 · see citing works
Is pathology prepared for the adoption of artificial intelligence?
Wong, S. T. C. (2018) · Cancer Cytopathology · doi:10.1002/cncy.21994 · Cited by 30 · see citing works
Factors that Influence the Adoption of Human-AI Collaboration in Clinical Decision-MakingPreprint
Hemmer, P., Schemmer, M., Riefle, L., Rosellen, N., Vössing, M., & Kühl, N. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.09082 · Cited by 26 · see citing works
Wenderott, K., Gambashidze, N., & Weigl, M. (2022) · JMIR Research Protocols · doi:10.2196/40485 · Cited by 11 · see citing works
Self-citationCatchpoole, J., Nanda, G., Vallmuur, K., Nand, G., & Lehto, M. R. (2022) · Applied Clinical Informatics · doi:10.1055/a-1863-7176 · Cited by 6 · see citing works
Schwappach, D. L. B., & Ratwani, R. M. (2023) · Journal of Patient Safety · doi:10.1097/pts.0000000000001130 · Cited by 3 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Wenderott, K., Krups, J., Zaruchas, F., & Weigl, M. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01248-9 · Cited by 150 · see citing works
Self-citationAbdelwanis, M., Simsekler, M. C. E., Gabor, A. F., Sleptchenko, A., & Omar, M. (2025) · Safety Science · doi:10.1016/j.ssci.2025.107028 · Cited by 79 · see citing works
Artificial Intelligence in Head and Neck Cancer: Innovations, Applications, and Future Directions
Pham, T. D., Teh, M., Chatzopoulou, D., Holmes, S., & Coulthard, P. (2024) · Current Oncology · doi:10.3390/curroncol31090389 · Cited by 70 · see citing works
Artificial intelligence for diagnostics in radiology practice: a rapid systematic scoping review
Lawrence, R., Dodsworth, E., Massou, E., Sherlaw-Johnson, C., Ramsay, A. I. G., Walton, H., O'Regan, T., Gleeson, F., Crellin, N., Herbert, K., et al. (2025) · eClinicalMedicine · doi:10.1016/j.eclinm.2025.103228 · Cited by 69 · see citing works
Liu, Y., Liu, C., Zheng, J., Xu, C., & Wang, D. (2025) · Journal of Medical Internet Research · doi:10.2196/73374 · Cited by 63 · see citing works
Kuo, R. Y. L., Freethy, A., Smith, J. H., Hill, R., Joanna, C., Jerome, D., Harriss, E., Collins, P. G. S., Tutton, E., & Furniss, D. (2024) · EClinicalMedicine · doi:10.1016/j.eclinm.2024.102555 · Cited by 50 · see citing works
Linguraru, M. G., Bakas, S., Aboian, M., Chang, P., Flanders, A. E., Kalpathy–Cramer, J., Kitamura, F., Lungren, M. P., Mongan, J., Prevedello, L. M. S., et al. (2024) · Radiology Artificial Intelligence · doi:10.1148/ryai.240225 · Cited by 39 · see citing works
Wenderott, K., Krups, J., Weigl, M., & Wooldridge, A. R. (2025) · Journal of Medical Internet Research · doi:10.2196/63649 · Cited by 25 · see citing works
Self-citationFactors influencing AI acceptance in radiology: a systematic review across the radiology workflow
Verwey, J., de Zwart, B. H. C., IJzerman, M. J., Visser, J. J., & Sülz, S. (2025) · European Radiology · doi:10.1007/s00330-025-12129-4 · Cited by 16 · see citing works
Ramsay, A. I. G., Crellin, N., Lawrence, R., Walton, H., Bagri, S., Dodsworth, E., Elphinstone, H., Gleeson, F., Halliday, A., Herbert, K., et al. (2025) · eClinicalMedicine · doi:10.1016/j.eclinm.2025.103481 · Cited by 13 · see citing works
“25,26 Many factors identified in our analysis—including context (at system, organization, and service levels), leadership and engagement approaches, technological considerations, use of data, and local capacity and resourcing (e.g., finance, people)–reflect established findings on implementation of…”
Luo, G., Tan, S., Luo, L., & Hu, K. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2025.1728248 · Cited by 13 · see citing works
Volin, J., van Assen, M., Bala, W., Safdar, N. M., & Balthazar, P. (2025) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2025.07.004 · Cited by 10 · see citing works
Transforming towards AI-augmented Healthcare: Experiences of physicians in Sweden
Ismail, M., Barth, H., Holmén, M., Petersson, L., & Irgang, L. (2025) · Technovation · doi:10.1016/j.technovation.2025.103333 · Cited by 10 · see citing works
Marey, A., Serdysnki, K. C., Killeen, B. D., Unberath, M., & Umair, M. (2024) · BJR|Artificial Intelligence · doi:10.1093/bjrai/ubae008 · Cited by 7 · see citing works
Not someone, but something: Rethinking trust in the age of medical AI
Beger, J. (2025) · European Journal of Radiology Artificial Intelligence · doi:10.1016/j.ejrai.2025.100038 · Cited by 5 · see citing works
Wenderott, K., Krups, J., & Weigl, M. (2026) · BMJ Open Quality · doi:10.1136/bmjoq-2025-003639 · Cited by 4 · see citing works
Self-citationWenderott, K., Krups, J., Zaruchas, F., Krawitz, P. M., Weigl, M., & Lesmann, H. (2025) · European Journal of Human Genetics · doi:10.1038/s41431-025-01875-0 · Cited by 3 · see citing works
Self-citationVersorgungsforschung zum Einsatz von künstlicher Intelligenz in der Gesundheitsversorgung
Weigl, M., & Wenderott, K. (2024) · Springer eBooks · doi:10.1007/978-3-658-42863-1_43 · Cited by 2 · see citing works
Self-citationZhang, Y., Cheng, S., Xu, J., Nan, B., & Zhou, H. (2025) · Journal of Applied Clinical Medical Physics · doi:10.1002/acm2.70430 · Cited by 1 · see citing works
Liu, G., Lin, Q., Zeng, X., Cao, Y., Li, T., Liu, C., Cai, Z., & Huang, X. (2026) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ae4166 · Cited by 1 · see citing works
A Native Strategy for Integrating Deep-Learning Models for Segmentation into a Radiological Viewer
Xiberta, P., Ruiz, M., Vila, M., Juanola, A. J. I., Puig, J., Vilanova, J. C., & Boada, I. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-025-01801-2 · Cited by 1 · see citing works
Overcoming Resistance to Change: Artificial Intelligence in the Energy Sector
Lambert, J. (2026) · Suranaree Journal of Social Science · doi:10.55766/sjss283481 · Cited by 1 · see citing works
Syailendra, E. A., Arshad, H., Lopez‐Ramirez, F., Tixier, F., Kawamoto, S., Fishman, E. K., & Chu, L. C. H. (2026) · Korean Journal of Radiology · doi:10.3348/kjr.2026.0003 · Cited by 1 · see citing works
A development framework for human work integrated AI systems in manufacturing
Yamamoto, Y., Muñoz, Á. A., & Sandström, K. (2025) · Frontiers in Manufacturing Technology · doi:10.3389/fmtec.2025.1601903 · Cited by 1 · see citing works
Ramsay, A. I. G., Herbert, K., Lawrence, R., Sherlaw‐Johnson, C., Bagri, S., Crellin, N. E., Dodsworth, E., Elphinstone, H., Halliday, A., Lloyd, J., et al. (2025) · Health and Social Care Delivery Research · doi:10.3310/gjar2722 · Cited by 1 · see citing works
Vasileiou, M., Wakefield, V., Dadswell, C., & Edwards, S. J. (2025) · Health Technology Assessment · doi:10.3310/gjse4912 · Cited by 1 · see citing works
Healthcare Procurement and Firm Innovation: Evidence from Ai-Powered EquipmentPreprint
Patsali, S., Pezzoni, M., & Krafft, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5374827
AI Revolutionizing Diagnostic Imaging: Enhancing Accuracy and Efficiency
Anusha, K., Pallerla, N., Manager, C. P. O. P. P., & Bachina, L. P. (2025) · International Journal of Multidisciplinary and Innovative Research · doi:10.58806/ijmir.2025.v2i10n01
Brown, J., Dashevsky, B. Z., Polat, D. S., Doo, F. X., Straus, C. M., Rozenshtein, A., & Retrouvey, M. (2026) · Academic Radiology · doi:10.1016/j.acra.2025.11.021
Ahmed, M. M., Adebayo, U. O., Othman, Z. K., Oweidat, M. H., Okesanya, O. J., Kasimieh, O., Musa, S. S., Ong, C. J. N., Branda, F., & Lucero‐Prisno, D. E. (2026) · Intelligent Oncology · doi:10.1016/j.intonc.2026.100071
Choudhary, S., Kansal, A. R., Rana, P. S., & Mahala, P. (2026) · International Journal of Clinical Nursing Research Society · doi:10.5005/ijcnrs-11024-0019
Balazadeh, K., Nygren, J., Gama, F., da Silva, M. A. R., Ploug, T., & Svedberg, P. (2026) · Research Square · doi:10.21203/rs.3.rs-11085511/v1
Song, Z., 侯东江, Zhang, T., Huang, H., Chen, X., Lu, X., Bai, D., Xie, X., Li, Y., Cao, T., et al. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-03338-2
Böhmer, N., & Schinnenburg, H. (2026) · Merits · doi:10.3390/merits6040029
Wenderott, K., Krups, J., Weigl, M., & Wooldridge, A. R. (2026) · Human Factors in Healthcare · doi:10.1016/j.hfh.2026.100161
Self-citationBrough, P. A., Zobair, K. M., Pool, J. K., Haskell, N., Houghton, L., Scuffham, P., Loy, J., Troth, A. C., Memon, S., Smithson, R., et al. (2026) · JMIR AI · doi:10.2196/101944
- Authors
- Wenderott, K., Krups, J., Luetkens, J. A., & Weigl, M.
- Affiliations
- University Hospital Bonn (DE)
- Corresponding author
- Wenderott, Katharina
- Venue
- Applied Ergonomics
- Publisher
- Elsevier BV
- Published
- 2024-05
- Volume
- 117
- Pages
- 104243
- ISSN
- 0003-6870 (ISSN-L)
- OpenAlex
- W4391433115
- Cited by
- 33
- References
- 52
- Citations by year
- 2026: 12 · 2025: 15 · 2024: 6
- FWCI
- 3.09
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Applied Ergonomics (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Rheinische Friedrich-Wilhelms-Universität Bonn
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiology practices and education
- Social Sciences › Sociology and Political Science › Information Systems Theories and Implementation
- Keywords
- AI implementation, computer-aided detection, prostate MRI, workflow integration, technology acceptance model, implementation barriers, implementation facilitators, AI usability
- MeSH terms
- Radiologists, Artificial Intelligence, Computers, Humans, Male, Software, Workflow
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
