Design of a Human-in-the-Loop Centered AI-Based Clinical Decision Support System for Professional Care Planning
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
In the healthcare sector in particular, the shortage of skilled workers is a major problem that will become even more acute in the future as a result of demographic change. One way to counteract this trend is to use intelligent systems to reduce the workload of healthcare professionals. AI-based clinical decision support systems (AICDSS) have already proven their worth in this area, while simultaneously improving medical care. More recently, AICDSS have also been characterized by their ability to leverage the increasing availability of clinical data to assist healthcare professionals and patients in a variety of situations based on structured and unstructured data. However, the need to access large amounts of data while adhering to strict privacy regulations and the dependence on user adoption have highlighted the need to further adapt the implementation of AICDSS to integrate with existing healthcare routines. A subproject of the ViKI pro research project investigates how AICDSS can be successfully integrated into professional care planning practice using a user-centered design thinking approach. This paper presents the design of the ViKI pro AICDSS and the challenges related to privacy, user acceptance, and the data base. It also describes the development of an AI-based cloud technology for data processing and exchange using federated learning, and the development of an explicable AI algorithm for recommending care interventions. The core of the AICDSS is a human-in-the-loop system for data validation, in which the output of the AI model is continuously verified by skilled personnel to ensure continuous improvement in accuracy and transparent interaction between AI and humans.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“while domain-specific studies clarify which metric trade-offs are acceptable in practice [80,118].”
From Human-in-the-Loop Artificial Intelligence: A Systematic Review of Concepts, Methods, and Applications (2026) · cites this paper as [80]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The future of digital health with federated learning
Rieke, N., Hancox, J., Li, W., Milletarì, F., Roth, H. R., Albarqouni, S., Bakas, S., Galtier, M. N., Landman, B. A., Maier-Hein, K., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00323-1 · Cited by 4,015
The potential for artificial intelligence in healthcare
Davenport, T., & Kalakota, R. (2019) · Future Healthcare Journal · doi:10.7861/futurehosp.6-2-94 · Cited by 3,800
Hannun, A. Y., Rajpurkar, P., Haghpanahi, M., Tison, G. H., Bourn, C., Turakhia, M. P., & Ng, A. Y. (2019) · Nature Medicine · doi:10.1038/s41591-018-0268-3 · Cited by 3,148
An overview of clinical decision support systems: Benefits, risks, and strategies for success
Sutton, R. T., Pincock, D., Baumgart, D. C., Sadowski, D. C., Fedorak, R. N., & Kroeker, K. I. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0221-y · Cited by 3,019
Kawamoto, K., Houlihan, C. A., Balas, E. A., & Lobach, D. F. (2005) · BMJ · doi:10.1136/bmj.38398.500764.8f · Cited by 2,703
Hunt, D. L., Haynes, R. B., Hanna, S. E., & Smith, K. (1998) · JAMA · doi:10.1001/jama.280.15.1339 · Cited by 1,669
Effect of Clinical Decision-Support Systems: A Systematic Review
Bright, T. J., Wong, A., Dhurjati, R., Bristow, E., Bastian, L., Coeytaux, R. R., Samsa, G., Hasselblad, V., Williams, J. W., Musty, M. D., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-1-201207030-00450 · Cited by 1,200
Federated learning for smart healthcare: A survey
Nguyen, D. C., Pham, Q.-V., Pathirana, P. N., Ding, M., Seneviratne, A., Lin, Z., Dobre, O., & Hwang, W.-J. (2023) · ACM Computing Surveys · doi:10.1145/3501296 · Cited by 827
Estimating the success of re-identifications in incomplete datasets using generative models
Rocher, L., Hendrickx, J. M., & de Montjoye, Y.-A. (2019) · Nature Communications · doi:10.1038/s41467-019-10933-3 · Cited by 816
Artificial intelligence-enabled healthcare delivery
Reddy, S., Fox, J., & Purohit, M. P. (2019) · Journal of the Royal Society of Medicine · doi:10.1177/0141076818815510 · Cited by 635
Research works printed but not linked: 2
- [1]1. European Commission. Joint Research Centre. Healthcare and long-term care workforce: demographic challenges and the potential contribution of migration and digital technology. [Internet]. LU: Publications Office, 2021. [cited 2023 April 29]. Available from: https://data.europa.eu/doi/10.2760/33427. · doi:10.2760/33427
- [43]43. Konečný J, McMahan H, Yu F, Richtarik P, Theertha S, Bacon D. Federated Learning: Strategies for Improving Communication Efficiency. arXiv. 2006;
Cited by
Lazaros, K., Vrahatis, A. G., & Kotsiantis, S. (2026) · Entropy · doi:10.3390/e28040377 · Cited by 50
Bayor, A. A., Li, J., Yang, I. A., & Varnfield, M. (2025) · Journal of Medical Internet Research · doi:10.2196/63733 · Cited by 46
“The utilization of emerging technologies such as XAI [39,43,93,105] holds promise in addressing these challenges by ensuring human comprehension of AI decisions.”
InfluentialArtificial intelligence across design thinking: a qualitative review
Mirzaei, A., Pazhouhan, M., Jahanbakht, M., & Eftekhari, F. (2026) · Design Science · doi:10.1017/dsj.2026.10054 · Cited by 14
User-Centered Design in AI Applications: A Systematic Literature Review
Wongso, B., Lienaka, K. N., Firstian, V., & Magdalena, Y. (2024) · International Conference on Information Management and Technology (ICIMTech) · doi:10.1109/icimtech63123.2024.10780823 · Cited by 10
Chain-of-Thought for Cancer Pathology Interpretation and Summarization
Mali, A., Kohut, A., & Templeton, J. M. (2025) · IEEE International Conference on Smart Computing · doi:10.1109/smartcomp65954.2025.00081 · Cited by 2
Advances in Closed-Loop Artificial Intelligence for Healthcare
Das, D., Adams, S. D., Corva, D. M., Bucknall, T. K., & Kouzani, A. Z. (2026) · Electronics · doi:10.3390/electronics15071396 · Cited by 3
Nasution, A. H., Noer, L. R., Alfarizi, M., & Syulthoni, Z. B. (2026) · Discover Sustainability · doi:10.1007/s43621-026-03608-9 · Cited by 1
“AI-enabled AI-enabled decision-support systems enhance managerial and clinical decision-making, while predictive analytics facilitate root cause analysis by identifying patterns and risks embedded in complex healthcare processes [43, 44].”
Enhancing Semantic Inference in Healthcare Systems With Ontology-Enriched NLP
Jaziri, W., & Sassi, N. (2025) · IEEE Access · doi:10.1109/access.2025.3632350 · Cited by 1
“To fully realize the revolutionary potential of unstructured data for clinical and public health decision-making, sophisticated data analytics techniques that adhere to privacy standards are needed [42].”
Artificial Intelligence in Nurse Handover: Opportunities, Risks, and Future Directions
Singh, K., Ahmed, S. K., & Nashwan, A. J. (2026) · Nursing Open · doi:10.1002/nop2.70723
Von der Forschung zur Praxis – Perspektiven und Visionen einer KI-gestützten Pflege
Wolf‐Ostermann, K., & Seibert, K. (2026) · Springer eBooks · doi:10.1007/978-3-662-73432-2_20
Metadata
- Authors
- Steffny, L., Dahlem, N., Reichl, L., Gisa, K., Greff, T., & Werth, D.
- Affiliations
- AWS-Institute for Digitized Products and Processes (DE)
- Corresponding author
- Steffny, Laura
- Venue
- Frontiers in Artificial Intelligence and Applications
- Publisher
- IOS Press
- Published
- 2023-06-22
- ISSN
- 0922-6389 (ISSN-L)
- 1879-8314
- OpenAlex
- W4381733658
- Cited by
- 8
- References
- 34
- Citations by year
- 2026: 4 · 2025: 2 · 2024: 2
- FWCI
- 2.89
- Type
- book chapter
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Frontiers in artificial intelligence and applications (publishedVersion, cc-by-nc)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- clinical decision support systems, human-in-the-loop, user-centered design, design thinking, federated learning, privacy-preserving data processing, data validation, workload reduction, health workforce shortage
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.