The DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index.
Designing Clinical Decision Support Systems (CDSS)—A User-Centered Lens of the Design Characteristics, Challenges, and Implications: Systematic Review
Open accessAbstract
Background: Clinical decision support systems (CDSS) have the potential to play a crucial role in enhancing health care quality by providing evidence-based information to clinicians at the point of care. Despite their increasing popularity, there is a lack of comprehensive research exploring their design characterization and trends. This limits our understanding and ability to optimize their functionality, usability, and adoption in health care settings. Objective: This systematic review examined the design characteristics of CDSS from a user-centered perspective, focusing on user-centered design (UCD), user experience (UX), and usability, to identify related design challenges and provide insights into the implications for future design of CDSS. Methods: This review followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) recommendations and used a grounded theory analytical approach to guide the conduct, data analysis, and synthesis. A search of 4 major electronic databases (PubMed, Web of Science, Scopus, and IEEE Xplore) was conducted for papers published between 2013 and 2023, using predefined design-focused keywords (design, UX, implementation, evaluation, usability, and architecture). Papers were included if they focused on a designed CDSS for a health condition and discussed the design and UX aspects (eg, design approach, architecture, or integration). Papers were excluded if they solely covered technical implementation or architecture (eg, machine learning methods) or were editorials, reviews, books, conference abstracts, or study protocols. Results: Out of 1905 initially identified papers, 40 passed screening and eligibility checks for a full review and analysis. Analysis of the studies revealed that UCD is the most widely adopted approach for designing CDSS, with all design processes incorporating functional or usability evaluation mechanisms. The CDSS reported were mainly clinician-facing and mostly stand-alone systems, with their design lacking consideration for integration with existing clinical information systems and workflows. Through a UCD lens, four key categories of challenges relevant to CDSS design were identified: (1) usability and UX, (2) validity and reliability, (3) data quality and assurance, and (4) design and integration complexities. Notably, a subset of studies incorporating Explainable artificial intelligence highlighted its emerging role in addressing key challenges related to validity and reliability by fostering explainability, transparency, and trust in CDSS recommendations, while also supporting collaborative validation with users. Conclusions: While CDSS show promise in enhancing health care delivery, identified challenges have implications for their future design, efficacy, and utilization. Adopting pragmatic UCD design approaches that actively involve users is essential for enhancing usability and addressing identified UX challenges. Integrating with clinical systems is crucial for interoperability and presents opportunities for AI-enabled CDSS that rely on large patient data. Incorporating emerging technologies such as Explainable Artificial Intelligence can boost trust and acceptance. Enabling functionality for CDSS to support both clinicians and patients can create opportunities for effective use in virtual care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
The Discovery of Grounded Theory: Strategies for Qualitative Research
Glaser, B. G., & Strauss, A. L. (2017) · Aldine (Routledge reprint) · doi:10.4324/9780203793206 · Cited by 25,789
Co-creation and the new landscapes of design
Sanders, E. B.-N., & Stappers, P. J. (2008) · CoDesign · doi:10.1080/15710880701875068 · Cited by 5,561 · cited 1×
“To achieve this, adoption of user-centered design (UCD) methodologies [15, 16], which emphasize active user engagement to understand and address their unique needs throughout the design, testing, and integration phases, offers significant advantages.”
Lost in knowledge translation: Time for a map?
Graham, I. D., Logan, J., Harrison, M. B., Straus, S. E., Tetroe, J., Caswell, W., & Robinson, N. (2006) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.47 · Cited by 4,705 · cited 1×
“In contrast, the knowledge-to-action framework focuses on knowledge creation and translation, engaging end users at specific framework stages [35].”
An overview of clinical decision support systems: Benefits, risks, and strategies for success
Sutton, R. T., Pincock, D., Baumgart, D. C., Sadowski, D. C., Fedorak, R. N., & Kroeker, K. I. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0221-y · Cited by 3,019 · cited 5×
“For instance, integrating CDSS with personal health record (PHR) systems would allow direct retrieval of patient records, while AI-enabled CDSS could access data from these integrated systems for training, predictive modeling, and decision support [2,95].”
InfluentialGarg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
Greenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A'Court, C., Hinder, S., Fahy, N., Procter, R., & Shaw, S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8775 · Cited by 2,887 · cited 1×
“The way a technology is designed impacts user engagement, interaction modalities, and its ability to meet specific user needs [11,12].”
Effect of Clinical Decision-Support Systems: A Systematic Review
Bright, T. J., Wong, A., Dhurjati, R., Bristow, E., Bastian, L., Coeytaux, R. R., Samsa, G., Hasselblad, V., Williams, J. W., Musty, M. D., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-1-201207030-00450 · Cited by 1,200 · cited 1×
“Studies show that CDSS improve clinician performance [3-5], assist with medical condition management [2,6], and enhance screening procedures [7, 8].”
Using grounded theory as a method for rigorously reviewing literature
Wolfswinkel, J. F., Furtmueller, E., & Wilderom, C. P. M. (2013) · European Journal of Information Systems · doi:10.1057/ejis.2011.51 · Cited by 1,154 · cited 2×
“For the analysis data, we followed the GTLR approach, which consists of 3 key analytical coding steps: open coding, axial coding, and selective coding [30].”
The ethics of AI in health care: A mapping review
Morley, J., Machado, C. C. V., Burr, C., Cowls, J., Joshi, I., Taddeo, M., & Floridi, L. (2020) · Social Science & Medicine · doi:10.1016/j.socscimed.2020.113172 · Cited by 1,105 · cited 1×
“…challenges in accessing requisite and curated data, particularly for AI-enabled CDSS. Privacy concerns necessitate stringent legal protocols for patient data acquisition, while compatibility issues related to data formatting and extraction further complicate access for AI-driven CDSS [92-94].”
Research works printed but not linked: 5
- Webster, MIS Q, 26, xiii
- Tarnowska, AMIA Jt Summits Transl Sci Proc, 2021
- Seitinger, Stud Health Technol Inform, 198
- Silva EAT Gomez IFL Arango JFF Smith JW Ocampo SU Hidalgo JE . Evaluation of satisfaction and usability of a clinical decision support system (CDSS) targeted for early obstetric risk assessment and patient follow-up. Presented at: Proceedings of the IADIS International Conference e-Health 2018; Madrid. 2018.URL: https://bit.ly/44PHend [Accessed 16-06-2025]
- Ronquillo, Yale J Biol Med, 85, 379
Cited by
Abbas, Q., Jeong, W., & Lee, S. W. (2025) · Healthcare · doi:10.3390/healthcare13172154 · Cited by 236
“Scalability, data interoperability, and usability are critical factors that determine whether these systems can transition from research prototypes to clinical tools [36,37].”
Yu, H., Chen, T., Zhang, X., Yang, Y., Liu, Q., Yang, C., Shen, K., Li, H., Tang, W., Zhong, X., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/77334 · Cited by 21
“They have been extensively applied in areas such as medication review, sepsis alerts, and risk prediction for deep vein thrombosis and pressure ulcers, including those designed to assist diagnosis [46,47].”
Thorakkattil, S. A., Sridhar, S. B., Abdulsalim, S., Karattuthodi, M. S., Chandra, P., & Unnikrishnan, M. K. (2025) · Healthcare · doi:10.3390/healthcare13172220 · Cited by 10
“Additionally, we reviewed the official websites of Indian hospitals to identify announcements regarding CDSS deployments [12–17].”
An interpretable deep learning framework for medical diagnosis using spectrogram analysis
Henna, S., Alcaraz, J. M. L., Rathnayake, U., & Amjath, M. (2025) · Healthcare Analytics · doi:10.1016/j.health.2025.100408 · Cited by 10
Artificial intelligence in respiratory medicine: From diagnosis to treatment and future directions
Chen, Z., Tang, Z., Ewing, R. M., Belkhatir, Z., & Wang, Y. (2026) · Chinese Medical Journal - Pulmonary and Critical Care Medicine · doi:10.1016/j.pccm.2026.05.005 · Cited by 3
“56 As conceptualized in the updated operational workflow ( Fig.”
Metadata
- Authors
- Bayor, A. A., Li, J., Yang, I. A., & Varnfield, M.
- Affiliations
- Commonwealth Scientific and Industrial Research Organisation (AU)
- The University of Queensland (AU)
- Corresponding author
- Bayor, Andrew A
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2025-06-20
- Volume
- 27
- Pages
- e63733-e63733
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC12463342
- OpenAlex
- W4409784533
- Semantic Scholar
- 79b3bb750c3df8e751b2ce87a9dd9865bf99d558
- Cited by
- 46
- References
- 99
- Citations by year
- 2026: 39 · 2025: 7
- FWCI
- 5.93
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- clinical decision support systems, user-centered design, user experience, usability, explainable AI, clinical workflow, reliability and validity, data quality, clinician trust, quality of care, evidence-based decision making, point-of-care decision support, system architecture, design challenges, health information technology evaluation, health information technology implementation
- MeSH terms
- User-Centered Design, Humans, Decision Support Systems, Clinical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Designing Clinical Decision Support Systems (CDSS)—A User-Centered Lens of the Design Characteristics, Challenges, and Implications: Systematic Review. https://app.cochat.ai/papers/10.2196/63733
- The paper
- Bayor, A. A., Li, J., Yang, I. A., & Varnfield, M. (2025). Designing Clinical Decision Support Systems (CDSS)—A User-Centered Lens of the Design Characteristics, Challenges, and Implications: Systematic Review. Journal of Medical Internet Research. https://doi.org/10.2196/63733
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

