A systematic review of technologies and standards used in the development of rule-based clinical decision support systems
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
A Clinical Decision Support System (CDSS) is a technology platform that uses medical knowledge with clinical data to provide customised advice for an individual patient's care. CDSSs use rules to encapsulate expert knowledge and rules engines to infer logic by evaluating rules according to a patient's specific information and related medical facts. However, CDSSs are by nature complex with a plethora of different technologies, standards and methods used to implement them and it can be difficult for practitioners to determine an appropriate solution for a specific scenario. This study's main goal is to provide a better understanding of different technical aspects of a CDSS, identify gaps in CDSS development and ultimately provide some guidelines to assist their translation into practice. We focus on issues related to knowledge representation including use of clinical ontologies, interoperability with EHRs, technology standards, CDSS architecture and mobile/cloud access. This study performs a systematic literature review of rule-based CDSSs that discuss the underlying technologies used and have evaluated clinical outcomes. From a search that yielded an initial set of 1731 papers, only 15 included an evaluation of clinical outcomes. This study has found that a large majority of papers did not include any form of evaluation and, for many that did include an evaluation, the methodology was not sufficiently rigorous to provide statistically significant results. From the 15 papers shortlisted, there were no RCT or quasi-experimental studies, only 6 used ontologies to represent domain knowledge, only 2 integrated with an EHR system, only 5 supported mobile use and only 3 used recognised healthcare technology standards (and all these were HL7 standards). Based on these findings, the paper provides some recommendations for future CDSS development.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability
Lombard, M., Snyder-Duch, J., & Bracken, C. C. (2002) · Human Communication Research · doi:10.1111/j.1468-2958.2002.tb00826.x · Cited by 3,068
An overview of clinical decision support systems: Benefits, risks, and strategies for success
Sutton, R. T., Pincock, D., Baumgart, D. C., Sadowski, D. C., Fedorak, R. N., & Kroeker, K. I. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0221-y · Cited by 3,019 · cited 2×
“Many CDSSs exist as standalone systems or as systems that cannot communicate effectively with other systems [41].”
BackgroundGreenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A'Court, C., Hinder, S., Fahy, N., Procter, R., & Shaw, S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8775 · Cited by 2,887 · cited 1×
“…business case can be made; experimental studies can be difficult to undertake and require careful planning and approval from a range of different parties and may be considered beyond the scope of the project; projects may not have the appropriate staff for development or evaluation (eg [52, 53].).”
BackgroundHealth Information Technology: An Updated Systematic Review With a Focus on Meaningful Use
Jones, S. S., Rudin, R. S., Perry, T., & Shekelle, P. G. (2014) · Annals of Internal Medicine · doi:10.7326/m13-1531 · Cited by 475
Cramer, G. R., Young, G. J., Singh, S., McGuire, J., & Kim, D. (2021) · BMC Health Services Research · doi:10.1186/s12913-020-05996-8 · Cited by 179
Cited by
AI-Driven Clinical Decision Support Systems: An Ongoing Pursuit of Potential
Elhaddad, M., & Hamam, S. (2024) · Cureus · doi:10.7759/cureus.57728 · Cited by 301
“Random Forests and Gradient Boosting Machines are popular DT algorithms known for their robustness and predictive performance in healthcare applications [7].”
BackgroundUnveiling Explainable AI in Healthcare: Current Trends, Challenges, and Future Directions
Noor, A. A., Manzoor, A., Mazhar Qureshi, M. D., Qureshi, M. A., & Rashwan, W. (2025) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.70018 · Cited by 52
Unveiling Explainable AI in Healthcare: Current Trends, Challenges, and Future Directions
Aziz, N. A., Manzoor, A., Mazhar Qureshi, M. D., Qureshi, M. A., & Rashwan, W. (2024) · doi:10.1101/2024.08.10.24311735 · Cited by 30
Metadata
- Authors
- Papadopoulos, P., Soflano, M., Chaudy, Y., Adejo, W., & Connolly, T. M.
- Venue
- Health and Technology
- Published
- 2022-05-27
- Volume
- 12
- Issue
- 4
- Pages
- 713-727
- ISSN
- 2190-7188 (ISSN-L)
- 2190-7196
- OpenAlex
- W4281733250
- Cited by
- 68
- References
- 5
- FWCI
- 1.97
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A systematic review of technologies and standards used in the development of rule-based clinical decision support systems. https://app.cochat.ai/papers/10.1007/s12553-022-00672-9
- The paper
- Papadopoulos, P., Soflano, M., Chaudy, Y., Adejo, W., & Connolly, T. M. (2022). A systematic review of technologies and standards used in the development of rule-based clinical decision support systems. Health and Technology. https://doi.org/10.1007/s12553-022-00672-9
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.