CoChat

Designing Clinical Decision Support Systems (CDSS)—A User-Centered Lens of the Design Characteristics, Challenges, and Implications: Systematic Review

Open access
Bayor, Andrew A, Li, Jane, Yang, Ian A, Varnfield, Marlien · 2025 · Journal of Medical Internet Research

The DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index.

Abstract

Background: Clinical decision support systems (CDSS) have the potential to play a crucial role in enhancing health care quality by providing evidence-based information to clinicians at the point of care. Despite their increasing popularity, there is a lack of comprehensive research exploring their design characterization and trends. This limits our understanding and ability to optimize their functionality, usability, and adoption in health care settings. Objective: This systematic review examined the design characteristics of CDSS from a user-centered perspective, focusing on user-centered design (UCD), user experience (UX), and usability, to identify related design challenges and provide insights into the implications for future design of CDSS. Methods: This review followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) recommendations and used a grounded theory analytical approach to guide the conduct, data analysis, and synthesis. A search of 4 major electronic databases (PubMed, Web of Science, Scopus, and IEEE Xplore) was conducted for papers published between 2013 and 2023, using predefined design-focused keywords (design, UX, implementation, evaluation, usability, and architecture). Papers were included if they focused on a designed CDSS for a health condition and discussed the design and UX aspects (eg, design approach, architecture, or integration). Papers were excluded if they solely covered technical implementation or architecture (eg, machine learning methods) or were editorials, reviews, books, conference abstracts, or study protocols. Results: Out of 1905 initially identified papers, 40 passed screening and eligibility checks for a full review and analysis. Analysis of the studies revealed that UCD is the most widely adopted approach for designing CDSS, with all design processes incorporating functional or usability evaluation mechanisms. The CDSS reported were mainly clinician-facing and mostly stand-alone systems, with their design lacking consideration for integration with existing clinical information systems and workflows. Through a UCD lens, four key categories of challenges relevant to CDSS design were identified: (1) usability and UX, (2) validity and reliability, (3) data quality and assurance, and (4) design and integration complexities. Notably, a subset of studies incorporating Explainable artificial intelligence highlighted its emerging role in addressing key challenges related to validity and reliability by fostering explainability, transparency, and trust in CDSS recommendations, while also supporting collaborative validation with users. Conclusions: While CDSS show promise in enhancing health care delivery, identified challenges have implications for their future design, efficacy, and utilization. Adopting pragmatic UCD design approaches that actively involve users is essential for enhancing usability and addressing identified UX challenges. Integrating with clinical systems is crucial for interoperability and presents opportunities for AI-enabled CDSS that rely on large patient data. Incorporating emerging technologies such as Explainable Artificial Intelligence can boost trust and acceptance. Enabling functionality for CDSS to support both clinicians and patients can create opportunities for effective use in virtual care.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/63733

Cites

102 of 102 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1. Flow diagram of the screening and selection process of included papers in the review. CDSS: clinical decision support systems.
Figure 1. Flow diagram of the screening and selection process of included papers in the review. CDSS: clinical decision support systems.CC BY · PubMed Central
Figure 2. Interaction and user-facing characteristics of clinical decision support systems.
Figure 2. Interaction and user-facing characteristics of clinical decision support systems.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 102 references

Research works printed but not linked: 5

  1. Webster, MIS Q, 26, xiii
  2. Tarnowska, AMIA Jt Summits Transl Sci Proc, 2021
  3. Seitinger, Stud Health Technol Inform, 198
  4. Silva EAT Gomez IFL Arango JFF Smith JW Ocampo SU Hidalgo JE . Evaluation of satisfaction and usability of a clinical decision support system (CDSS) targeted for early obstetric risk assessment and patient follow-up. Presented at: Proceedings of the IADIS International Conference e-Health 2018; Madrid. 2018.URL: https://bit.ly/44PHend [Accessed 16-06-2025]
  5. Ronquillo, Yale J Biol Med, 85, 379

Cited by

Metadata

Authors
Bayor, A. A., Li, J., Yang, I. A., & Varnfield, M.
Affiliations
  • Commonwealth Scientific and Industrial Research Organisation (AU)
  • The University of Queensland (AU)
Corresponding author
Bayor, Andrew A
Venue
Journal of Medical Internet Research
Published
2025-06-20
Volume
27
Pages
e63733-e63733
ISSN
1438-8871 (ISSN-L)
OpenAlex
W4409784533
Cited by
46
References
99
Citations by year
2026: 39 · 2025: 7
FWCI
5.93
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Keywords
clinical decision support systems, user-centered design, user experience, usability, explainable AI, clinical workflow, reliability and validity, data quality, clinician trust, quality of care, evidence-based decision making, point-of-care decision support, system architecture, design challenges, health information technology evaluation, health information technology implementation
MeSH terms
User-Centered Design, Humans, Decision Support Systems, Clinical

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.