CoChat

Effect of Clinical Decision-Support Systems: A Systematic Review

The DOI matches its Crossref record; 175 of the 175 references it cites were found in a registry or an index.

Abstract

BACKGROUND: Despite increasing emphasis on the role of clinical decision-support systems (CDSSs) for improving care and reducing costs, evidence to support widespread use is lacking. PURPOSE: To evaluate the effect of CDSSs on clinical outcomes, health care processes, workload and efficiency, patient satisfaction, cost, and provider use and implementation. DATA SOURCES: MEDLINE, CINAHL, PsycINFO, and Web of Science through January 2011. STUDY SELECTION: Investigators independently screened reports to identify randomized trials published in English of electronic CDSSs that were implemented in clinical settings; used by providers to aid decision making at the point of care; and reported clinical, health care process, workload, relationship-centered, economic, or provider use outcomes. DATA EXTRACTION: Investigators extracted data about study design, participant characteristics, interventions, outcomes, and quality. DATA SYNTHESIS: 148 randomized, controlled trials were included. A total of 128 (86%) assessed health care process measures, 29 (20%) assessed clinical outcomes, and 22 (15%) measured costs. Both commercially and locally developed CDSSs improved health care process measures related to performing preventive services (n= 25; odds ratio [OR], 1.42 [95% CI, 1.27 to 1.58]), ordering clinical studies (n= 20; OR, 1.72 [CI, 1.47 to 2.00]), and prescribing therapies (n= 46; OR, 1.57 [CI, 1.35 to 1.82]). Few studies measured potential unintended consequences or adverse effects. LIMITATIONS: Studies were heterogeneous in interventions, populations, settings, and outcomes. Publication bias and selective reporting cannot be excluded. CONCLUSION: Both commercially and locally developed CDSSs are effective at improving health care process measures across diverse settings, but evidence for clinical, economic, workload, and efficiency outcomes remains sparse. This review expands knowledge in the field by demonstrating the benefits of CDSSs outside of experienced academic centers. PRIMARY FUNDING SOURCE: Agency for Healthcare Research and Quality.

Overview

Integrity signals

Registry

Crossref · 10.7326/0003-4819-157-1-201207030-00450

Cites

175 of 175 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 175 references

Research works printed but not linked: 29

  1. Bryan C, 2008, Inform Prim Care, 16, 79
  2. Gilutz H, 2009, Isr Med Assoc J, 11, 23
  3. McDonald CJ, 1992, MD Comput, 9, 304
  4. Frank O, 2004, Aust Fam Physician, 33, 87
  5. McDowell I, 1986, CMAJ, 135, 991
  6. McDowell I, 1989, J Fam Pract, 28, 420
  7. 10.1001/archinte.1996.00440130095010 · DOI · Paper page
  8. Price M, 2005, Can Fam Physician, 51, 1506
  9. Chambers CV, 1989, J Fam Pract, 29, 273
  10. Flanagan JR, 1999, Proc AMIA Symp, 755
  11. Fordham D, 1990, MD Comput, 7, 289
  12. 10.1001/archinte.1989.00390080116025 · doi:10.1001/archinte.1989.00390080116025 · Paper page
  13. Lobach DF, 1994, Proc Annu Symp Comput Appl Med Care, 787
  14. Ornstein SM, 1991, J Fam Pract, 32, 82
  15. Rosser WW, 1992, CMAJ, 146, 911
  16. Rosser WW, 1991, CMAJ, 145, 807
  17. Greiver M, 2005, Can Fam Physician, 51, 382
  18. Palen TE, 2006, Am J Manag Care, 12, 389
  19. Palen TE, 2010, Am J Manag Care, 16, 267
  20. Player MS, 2010, Qual Prim Care, 18, 223
  21. Schriefer SP, 2009, Fam Med, 41, 502
  22. Krall MA, 2004, Stud Health Technol Inform, 107, 135
  23. Locatelli F, 2009, J Nephrol, 22, 662
  24. Manotti C, 2001, Haematologica, 86, 1060
  25. Martens JD, 2006, Stud Health Technol Inform, 124, 617
  26. Peterson JF, 2007, Stud Health Technol Inform, 129, 1037
  27. Tamblyn R, 2003, CMAJ, 169, 549
  28. 10.1001/jama.1988.03720080028023 · doi:10.1001/jama.1988.03720080028023 · Paper page
  29. Smith DH, 2009, Am J Manag Care, 15, 281

Cited by

See all 1,200

Metadata

Authors
Bright, T. J., Wong, A., Dhurjati, R., Bristow, E., Bastian, L., Coeytaux, R. R., Samsa, G., Hasselblad, V., Williams, J. W., Musty, M. D., Wing, L., Kendrick, A. S., Sanders, G. D., & Lobach, D.
Affiliations
  • Duke University (US)
  • From Duke Evidence-based Practice Center, Duke Clinical Research Institute, Duke University School of Medicine, Durham, North Carolina, and School of Medicine, University of Utah, Salt Lake City, Utah.
Venue
Annals of Internal Medicine
Published
2012-07-03
Volume
157
Issue
1
Pages
29-43
ISSN
  • 0003-4819 (ISSN-L)
  • 1539-3704
OpenAlex
W2073924861
Cited by
1,200
References
175
Citations by year
2026: 84 · 2025: 107 · 2024: 92 · 2023: 106 · 2022: 118 · 2021: 110 · 2020: 92 · 2019: 87 · 2018: 68 · 2017: 63 · 2016: 62 · 2015: 78 · 2014: 67 · 2013: 56 · 2012: 10
FWCI
109.69
Type
journal article
Language
en
Open access
closed
Licence
www.acpjournals.org/journal/aim/text-and-data-mining (tdm)
Locations
  • Annals of Internal Medicine (publishedVersion)
  • PubMed (publishedVersion)
Funders
U.S. Public Health Service (290-2007-10066-I)
Topics
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
Keywords
clinical decision support systems, electronic health records, preventive services, drug prescribing, clinical outcomes, health care costs, provider workload, patient satisfaction
MeSH terms
Cost-Benefit Analysis, Humans, Randomized Controlled Trials as Topic, Treatment Outcome, Decision Support Systems, Clinical

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Effect of Clinical Decision-Support Systems: A Systematic Review. https://app.cochat.ai/papers/10.7326/0003-4819-157-1-201207030-00450
The paper
Bright, T. J., Wong, A., Dhurjati, R., Bristow, E., Bastian, L., Coeytaux, R. R., Samsa, G., Hasselblad, V., Williams, J. W., Musty, M. D., Wing, L., Kendrick, A. S., Sanders, G. D., & Lobach, D. (2012). Effect of Clinical Decision-Support Systems: A Systematic Review. Annals of Internal Medicine. https://doi.org/10.7326/0003-4819-157-1-201207030-00450

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.