Designing Clinical Decision Support Systems (CDSS)—A User-Centered Lens of the Design Characteristics, Challenges, and Implications: Systematic Review
Open accessThe DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index.
Abstract
Background: Clinical decision support systems (CDSS) have the potential to play a crucial role in enhancing health care quality by providing evidence-based information to clinicians at the point of care. Despite their increasing popularity, there is a lack of comprehensive research exploring their design characterization and trends. This limits our understanding and ability to optimize their functionality, usability, and adoption in health care settings. Objective: This systematic review examined the design characteristics of CDSS from a user-centered perspective, focusing on user-centered design (UCD), user experience (UX), and usability, to identify related design challenges and provide insights into the implications for future design of CDSS. Methods: This review followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) recommendations and used a grounded theory analytical approach to guide the conduct, data analysis, and synthesis. A search of 4 major electronic databases (PubMed, Web of Science, Scopus, and IEEE Xplore) was conducted for papers published between 2013 and 2023, using predefined design-focused keywords (design, UX, implementation, evaluation, usability, and architecture). Papers were included if they focused on a designed CDSS for a health condition and discussed the design and UX aspects (eg, design approach, architecture, or integration). Papers were excluded if they solely covered technical implementation or architecture (eg, machine learning methods) or were editorials, reviews, books, conference abstracts, or study protocols. Results: Out of 1905 initially identified papers, 40 passed screening and eligibility checks for a full review and analysis. Analysis of the studies revealed that UCD is the most widely adopted approach for designing CDSS, with all design processes incorporating functional or usability evaluation mechanisms. The CDSS reported were mainly clinician-facing and mostly stand-alone systems, with their design lacking consideration for integration with existing clinical information systems and workflows. Through a UCD lens, four key categories of challenges relevant to CDSS design were identified: (1) usability and UX, (2) validity and reliability, (3) data quality and assurance, and (4) design and integration complexities. Notably, a subset of studies incorporating Explainable artificial intelligence highlighted its emerging role in addressing key challenges related to validity and reliability by fostering explainability, transparency, and trust in CDSS recommendations, while also supporting collaborative validation with users. Conclusions: While CDSS show promise in enhancing health care delivery, identified challenges have implications for their future design, efficacy, and utilization. Adopting pragmatic UCD design approaches that actively involve users is essential for enhancing usability and addressing identified UX challenges. Integrating with clinical systems is crucial for interoperability and presents opportunities for AI-enabled CDSS that rely on large patient data. Incorporating emerging technologies such as Explainable Artificial Intelligence can boost trust and acceptance. Enabling functionality for CDSS to support both clinicians and patients can create opportunities for effective use in virtual care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
The Discovery of Grounded Theory: Strategies for Qualitative Research
Glaser, B. G., & Strauss, A. L. (2017) · Aldine (Routledge reprint) · doi:10.4324/9780203793206 · Cited by 25,789
Co-creation and the new landscapes of design
Sanders, E. B.-N., & Stappers, P. J. (2008) · CoDesign · doi:10.1080/15710880701875068 · Cited by 5,561 · cited 1×
“To achieve this, adoption of user-centered design (UCD) methodologies [15, 16], which emphasize active user engagement to understand and address their unique needs throughout the design, testing, and integration phases, offers significant advantages.”
Lost in knowledge translation: Time for a map?
Graham, I. D., Logan, J., Harrison, M. B., Straus, S. E., Tetroe, J., Caswell, W., & Robinson, N. (2006) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.47 · Cited by 4,705 · cited 1×
“In contrast, the knowledge-to-action framework focuses on knowledge creation and translation, engaging end users at specific framework stages [35].”
An overview of clinical decision support systems: Benefits, risks, and strategies for success
Sutton, R. T., Pincock, D., Baumgart, D. C., Sadowski, D. C., Fedorak, R. N., & Kroeker, K. I. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0221-y · Cited by 3,019 · cited 5×
“For instance, integrating CDSS with personal health record (PHR) systems would allow direct retrieval of patient records, while AI-enabled CDSS could access data from these integrated systems for training, predictive modeling, and decision support [2,95].”
InfluentialGarg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
Greenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A'Court, C., Hinder, S., Fahy, N., Procter, R., & Shaw, S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8775 · Cited by 2,887 · cited 1×
“The way a technology is designed impacts user engagement, interaction modalities, and its ability to meet specific user needs [11,12].”
Effect of Clinical Decision-Support Systems: A Systematic Review
Bright, T. J., Wong, A., Dhurjati, R., Bristow, E., Bastian, L., Coeytaux, R. R., Samsa, G., Hasselblad, V., Williams, J. W., Musty, M. D., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-1-201207030-00450 · Cited by 1,200 · cited 1×
“Studies show that CDSS improve clinician performance [3-5], assist with medical condition management [2,6], and enhance screening procedures [7, 8].”
Using grounded theory as a method for rigorously reviewing literature
Wolfswinkel, J. F., Furtmueller, E., & Wilderom, C. P. M. (2013) · European Journal of Information Systems · doi:10.1057/ejis.2011.51 · Cited by 1,154 · cited 2×
“For the analysis data, we followed the GTLR approach, which consists of 3 key analytical coding steps: open coding, axial coding, and selective coding [30].”
The ethics of AI in health care: A mapping review
Morley, J., Machado, C. C. V., Burr, C., Cowls, J., Joshi, I., Taddeo, M., & Floridi, L. (2020) · Social Science & Medicine · doi:10.1016/j.socscimed.2020.113172 · Cited by 1,105 · cited 1×
“…challenges in accessing requisite and curated data, particularly for AI-enabled CDSS. Privacy concerns necessitate stringent legal protocols for patient data acquisition, while compatibility issues related to data formatting and extraction further complicate access for AI-driven CDSS [92-94].”
Research works printed but not linked: 5
- Webster, MIS Q, 26, xiii
- Tarnowska, AMIA Jt Summits Transl Sci Proc, 2021
- Seitinger, Stud Health Technol Inform, 198
- Silva EAT Gomez IFL Arango JFF Smith JW Ocampo SU Hidalgo JE . Evaluation of satisfaction and usability of a clinical decision support system (CDSS) targeted for early obstetric risk assessment and patient follow-up. Presented at: Proceedings of the IADIS International Conference e-Health 2018; Madrid. 2018.URL: https://bit.ly/44PHend [Accessed 16-06-2025]
- Ronquillo, Yale J Biol Med, 85, 379
Cited by
Abbas, Q., Jeong, W., & Lee, S. W. (2025) · Healthcare · doi:10.3390/healthcare13172154 · Cited by 236
“Scalability, data interoperability, and usability are critical factors that determine whether these systems can transition from research prototypes to clinical tools [36,37].”
Yu, H., Chen, T., Zhang, X., Yang, Y., Liu, Q., Yang, C., Shen, K., Li, H., Tang, W., Zhong, X., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/77334 · Cited by 21
“They have been extensively applied in areas such as medication review, sepsis alerts, and risk prediction for deep vein thrombosis and pressure ulcers, including those designed to assist diagnosis [46,47].”
Thorakkattil, S. A., Sridhar, S. B., Abdulsalim, S., Karattuthodi, M. S., Chandra, P., & Unnikrishnan, M. K. (2025) · Healthcare · doi:10.3390/healthcare13172220 · Cited by 10
“Additionally, we reviewed the official websites of Indian hospitals to identify announcements regarding CDSS deployments [12–17].”
An interpretable deep learning framework for medical diagnosis using spectrogram analysis
Henna, S., Alcaraz, J. M. L., Rathnayake, U., & Amjath, M. (2025) · Healthcare Analytics · doi:10.1016/j.health.2025.100408 · Cited by 10
Artificial intelligence in respiratory medicine: From diagnosis to treatment and future directions
Chen, Z., Tang, Z., Ewing, R. M., Belkhatir, Z., & Wang, Y. (2026) · Chinese Medical Journal - Pulmonary and Critical Care Medicine · doi:10.1016/j.pccm.2026.05.005 · Cited by 3
“56 As conceptualized in the updated operational workflow ( Fig.”
Chang, J., Peng, R., Chen, X., Zhu, Y., Miao, R., Cao, Z., & Feng, H. (2026) · Journal of Medical Internet Research · doi:10.2196/84726 · Cited by 4
“Their successful deployment may be constrained by existing clinical workflows and health care systems’ capacity to integrate novel communication tools alongside training resources [147,148].”
Bayor, A. A., Li, J., Yang, I. A., & Varnfield, M. (2025) · Journal of Medical Internet Research · doi:10.2196/84380 · Cited by 2
Self-citationKubota, K., & Kubota, A. (2026) · Applied Sciences · doi:10.3390/app16073131 · Cited by 2
User-Directed vs Interruptive Real-Time Benefit Tools for Medication Changes in Primary Care
Kane, R. M., Morton-Oswald, S., Lokhnygina, Y. V., Maciejewski, M. L., & Sloan, C. E. (2026) · JAMA Network Open · doi:10.1001/jamanetworkopen.2026.15767 · Cited by 2
Screening for Missed Opportunities for Diagnosis in the ED Using eTriggers and Large Language Models
Marks, C. M., Gibney, S., Stenson, B. A., Sarma, D., Gaudet, C., Mombini, H., Buckley, T. A., Keko, M., Nathanson, L. A., Burke, L. G., et al. (2026) · JAMA Network Open · doi:10.1001/jamanetworkopen.2026.20939 · Cited by 2
Naye, F., Ouellet, S., Yousefi, F., Cachinho, C., Bergeron, F., Bhattacharyya, O. K., Stamenova, V., & Sasseville, M. (2026) · doi:10.2196/preprints.96882 · Cited by 1
Aydın, E. M., Balas, Ş., Örüç, N. E., Atar, F., Parlak, B., & Tezcan, B. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-13778-3
“Mucha et al. emphasized that a key determinant of the effectiveness of CDSS is its usability, while Bayor et al. emphasized the importance of user-centered design [5, 6].”
Liang, S., Liang, C., Chen, W., Huang, C., Lai, C., Lin, I., Chang, H., Hsu, Y., Yeh, C., Chang‐Chien, P., et al. (2025) · British Journal of Clinical Pharmacology · doi:10.1002/bcp.70397
“8,9,15,18,23 For example, initial CDSS-adherence to colistin recommendations was low ( (cid:4) 45”
Baştuğ, B. T., & Güney, T. (2026) · Tomography · doi:10.3390/tomography12020016
“…relevant laboratory markers (when applicable), imaging findings, and explicit decision nodes, the framework addresses a recognized limitation of acute care reporting: the absence of a unified structure that consistently links these elements to a clear management-oriented conclusion [13,14].”
Wu, D., Zheng, F., Chen, Y., Zhang, X., Xu, Y., Chen, H., Zhou, Y., Ni, W., Zhang, X., Wang, Y., et al. (2026) · Frontiers in Pediatrics · doi:10.3389/fped.2026.1736268
Fidel, A., Mai, M. V., Muthu, N., & Dziorny, A. C. (2026) · JMIR Human Factors · doi:10.2196/79952
“The HCD approach we targeted was synthesized across diverse health innovations and health IT including CDS [24-JMIR 26].”
Babirye, S., Turyabagye, B., Tigist, M., Namugeere, H. M., Owarwo, N. C., Ddungu, A., Shifferaw, B. M., Koburongo, O., Ayebale, T., Kitibwa, R., et al. (2026) · doi:10.12688/verixiv.2433.1
Pratyak, A. S. G. S. (2026) · Cureus · doi:10.7759/cureus.107847 · Cited by 2
“In medicine, these technologies are being applied to a wide range of tasks, including radiological interpretation, pathology, genomic analysis, risk prediction, real-time monitoring, and clinical workflow support [3].”
Training Clinicians for Tech-Enhanced Practice
(2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-4997-8.ch012
Extended Reality as a Clinical Instrument
(2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-4997-8.ch005
Ethics, Consent, and the Moral Architecture of Digital Mental Health
(2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-4997-8.ch003
The Role of Digital Technologies in Mental Health Care
(2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-4997-8.ch001
The Future of Neuroadaptive Mental Health Care
(2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-4997-8.ch015
Digital Mental Health in Older Adulthood
(2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-4997-8.ch010
Nissinen, S. P., Toivio, P., & Sormunen, E. (2026) · Digital Health · doi:10.1177/20552076261450324
Cai, J., Li, P., Feng, X., Wang, Y., Li, W., Chen, G., Zhu, T., Hao, X., & AIR-CG group (2026) · doi:10.2196/preprints.101309
Han, Y. H., Ouyang, W., Du, H., Ma, M., & Wang, G. (2026) · Journal of Eye Movement Research · doi:10.3390/jemr19030055
Tian, E., Wilson, O. W. A., Schneider, J. D., Street, R. L., & Jayasekera, J. C. (2026) · JMIR Formative Research · doi:10.2196/89463
“First, applying user-centered design principles with an iterative process helped tailor the tool to meet the specific needs and preferences of its intended users [67,68].”
A Hybrid Machine Learning and Automata-Based Explainable Clinical Decision Support
Pande, S., Gavit, A., Pagar, P., Pardeshi, T., Rikame, R. J., & Ranjan, M. K. (2026) · International Conference on Recent Trends in Computer Science and Technology (ICRTCST) · doi:10.1109/icrtcst68392.2026.11545186
“While Clinical Decision Support Systems (CDSS) are very helpful, they usually function as “black - box” models, which means that they have limited transparency and the clinician’s trust is reduced [2].”
Vannelli, S., Spoladore, D., & Visintin, F. (2026) · Journal of Medical Internet Research · doi:10.2196/88366
“Our review highlighted that, although numerous DSS exist to assist various types of clinical decision-making [46,47], none have been specifically developed to support the evaluation of MDs and their introduction into health care organizations.”
Zantvoort, K., Brouwer, S., Schlicker, N., Mross, P. M., Jerrentrup, A., Hirsch, M. C., & Russ, P. G. (2026) · Frontiers in Digital Health · doi:10.21203/rs.3.rs-10003720/v1
Naye, F., Ouellet, S., Yousefi, F., Cachinho, C., Bergeron, F., Bhattacharyya, O. K., Stamenova, V., & Sasseville, M. (2026) · Journal of Medical Internet Research · doi:10.2196/96882 · Cited by 2
“Workflow integration, usability, and health care system–level factors have also been identified as persistent implementation challenges across clinical domains and CDSS types [53,110], reinforcing the importance of aligning decision support systems with routine clinical work [29,32].”
User Interface Design for AI-Based Medical Imaging: A Scoping Review
Souza, I. C. A., & Berton, L. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-026-02140-6
Søgaard, S. N., Ward, L., Mogensen, M. L., Mogensen, C. B., Cartuliares, M. B., & Skjøt‐Arkil, H. (2026) · JAC-Antimicrobial Resistance · doi:10.1093/jacamr/dlag160
Li, J., Rahman, J. S., Phillips, N. T., Nguyen, A., & Delaforce, A. (2026) · Research Square · doi:10.21203/rs.3.rs-10465968/v1
Self-citationSu, H., zou, Y., Hu, Y., Zheng, Y., Yu, Z., Yang, C., Zhang, Q., & Qin, W. (2026) · Nursing Open · doi:10.1002/nop2.70798
“…embed context-aware decision support modules to assist nurses in coping with uncertainties, while providing limited autonomous options (such as personalised nursing plan templates) within a compliant framework (Bayor et al. 2025), Note: Bootstrap estimates (SE and CI) are based on 5000 samples.”
Lichtenegger, K. M., SCHOLLE, L. K., Kopanz, J., Libiseller, A., Donsa, K., Aberer, F., Pieber, T. R., & Mader, J. K. (2026) · JMIR Nursing · doi:10.2196/89687
“Recent digital health research further emphasizes that successful implementation of health technologies requires the combined evaluation of usability, user experience, and implementation outcomes as these factors jointly influence adoption, safety, and long-term sustainability [33].”
Chan, C. T., Balakrishnan, K., Scheffler, A., Hswen, Y., Yeager, J., & Pletcher, M. J. (2026) · Applied Clinical Informatics · doi:10.1055/a-2969-1041
“36 , 37 , 41 48 For pediatric SSI prevention, a human-centered approach is essential to ensure that risk information and recommendations are interpretable, actionable, and appropriately contextualized for diverse surgical specialties.”
InfluentialBrobbey, A. A., Bhosale¹, N., & Ackom, J. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1864565
“And their explanations must satisfy operational stakeholders who lack clinical AI training, a user population entirely absent from existing XAI healthcare literature (Chen et al., 2020; Nasef et al., 2025; Bayor et al., 2025; Pahlevani et al., 2024).”
Transforming musculoskeletal injury management using Virtual Bones: a novel digital solution
Mansour, M. A., Al-Kulabi, A., Abbas, M., Qaraqe, L., Uwaoma, S., Al-Sukaini, A., Young, L., & Deakin, S. (2026) · BMJ Open Quality · doi:10.1136/bmjoq-2025-004121
Ashour, F. O. M., Sami, W., Alrimawi, I., Rizvi, M. R., & El‐Banna, M. M. (2026) · Journal of Medical Internet Research · doi:10.2196/93931
“Recent user-centered evidence further indicates that interface clarity, usability, workflow fit, customization, and stakeholder involvement are important determinants of the acceptance and integration of clinical decision support systems (CDSSs) [36].”
A Modality-Adaptive Software Architecture for Explainable Clinical Decision Support
Lissovoy, D., Khalyk, A., Oralov, A., Mustafin, R., Kenzhegaliyev, A., & Ali, H. (2026) · GlobeIS International Journal of Global Information Systems · doi:10.66395/globeis.25
“The interface uses prior literature as a design rationale by using a concise initial result and optional detail [16,18].”
Hallquist, M. L. G., Brangan, A., Cawley, D., Gabriel, J. L., Kunnmann, M., Ly, K., Morales, A., Romagnoli, K. M., Savatt, J. M., Walters, N., et al. (2026) · Current Atherosclerosis Reports · doi:10.1007/s11883-026-01477-1
Permadi, Y. W., Akrom, Riadi, I., & Rahmatullah, S. (2026) · Bangladesh Journal of Multidisciplinary Scientific Research · doi:10.46281/bjmsr.v12i1.2994
Dong, N., & Gan, K. (2026) · International Conference on Biomedical and Intelligent Systems (IC-BIS) · doi:10.1145/3841905.3842002
“From the system-design side, it must also account for user-centered integration [8], a transparent display of explanatory evidence [9], and explainable disease-prediction workflows [10].”
Martikainen, S., Viitanen, J., Erola, E., Milja, R., Kilpi, J., & Lääveri, T. (2026) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2026.106772
EXAIM: Explainable AI Middleware for Real-Time Multi-Agent Clinical Decision Support
Woldesenbet, A. K., & Behrens, A. (2026) · 2026 IEEE 14th International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi69079.2026.00109
Metadata
- Authors
- Bayor, A. A., Li, J., Yang, I. A., & Varnfield, M.
- Affiliations
- Commonwealth Scientific and Industrial Research Organisation (AU)
- The University of Queensland (AU)
- Corresponding author
- Bayor, Andrew A
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2025-06-20
- Volume
- 27
- Pages
- e63733-e63733
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC12463342
- OpenAlex
- W4409784533
- Semantic Scholar
- 79b3bb750c3df8e751b2ce87a9dd9865bf99d558
- Cited by
- 46
- References
- 99
- Citations by year
- 2026: 39 · 2025: 7
- FWCI
- 5.93
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- clinical decision support systems, user-centered design, user experience, usability, explainable AI, clinical workflow, reliability and validity, data quality, clinician trust, quality of care, evidence-based decision making, point-of-care decision support, system architecture, design challenges, health information technology evaluation, health information technology implementation
- MeSH terms
- User-Centered Design, Humans, Decision Support Systems, Clinical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

