Effect of Clinical Decision-Support Systems: A Systematic Review
The DOI matches its Crossref record; 175 of the 175 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Despite increasing emphasis on the role of clinical decision-support systems (CDSSs) for improving care and reducing costs, evidence to support widespread use is lacking. PURPOSE: To evaluate the effect of CDSSs on clinical outcomes, health care processes, workload and efficiency, patient satisfaction, cost, and provider use and implementation. DATA SOURCES: MEDLINE, CINAHL, PsycINFO, and Web of Science through January 2011. STUDY SELECTION: Investigators independently screened reports to identify randomized trials published in English of electronic CDSSs that were implemented in clinical settings; used by providers to aid decision making at the point of care; and reported clinical, health care process, workload, relationship-centered, economic, or provider use outcomes. DATA EXTRACTION: Investigators extracted data about study design, participant characteristics, interventions, outcomes, and quality. DATA SYNTHESIS: 148 randomized, controlled trials were included. A total of 128 (86%) assessed health care process measures, 29 (20%) assessed clinical outcomes, and 22 (15%) measured costs. Both commercially and locally developed CDSSs improved health care process measures related to performing preventive services (n= 25; odds ratio [OR], 1.42 [95% CI, 1.27 to 1.58]), ordering clinical studies (n= 20; OR, 1.72 [CI, 1.47 to 2.00]), and prescribing therapies (n= 46; OR, 1.57 [CI, 1.35 to 1.82]). Few studies measured potential unintended consequences or adverse effects. LIMITATIONS: Studies were heterogeneous in interventions, populations, settings, and outcomes. Publication bias and selective reporting cannot be excluded. CONCLUSION: Both commercially and locally developed CDSSs are effective at improving health care process measures across diverse settings, but evidence for clinical, economic, workload, and efficiency outcomes remains sparse. This review expands knowledge in the field by demonstrating the benefits of CDSSs outside of experienced academic centers. PRIMARY FUNDING SOURCE: Agency for Healthcare Research and Quality.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Clinical decision support (CDS) systems play a crucial role in assisting healthcare professionals in the interpretation of test results, mitigating interpretative subjectivity, and minimizing inconsistencies [12].”
From Machine learning-based clinical decision support using laboratory data (2024) · cites this paper as [12]
In the citing paper
“This, in turn, reduces diagnostic delays, minimizes error-prone revisions, and enhances the consistency and reliability of clinical decisions, ultimately leading to better patient outcomes [30].”
From Enhancing Clinician Trust in AI Diagnostics: A Dynamic Framework for Confidence Calibration and Transparency (2025) · cites this paper as [30]
Citations
Cites
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Chaudhry, B., Wang, J., Wu, S., Maglione, M., Mojica, W., Roth, E., Morton, S. C., & Shekelle, P. G. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-10-200605160-00125 · Cited by 3,159
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
Kawamoto, K., Houlihan, C. A., Balas, E. A., & Lobach, D. F. (2005) · BMJ · doi:10.1136/bmj.38398.500764.8f · Cited by 2,703
Self-citationHunt, D. L., Haynes, R. B., Hanna, S. E., & Smith, K. (1998) · JAMA · doi:10.1001/jama.280.15.1339 · Cited by 1,669
Buntin, M. B., Burke, M. F., Hoaglin, M. C., & Blumenthal, D. (2011) · Health Affairs · doi:10.1377/hlthaff.2011.0178 · Cited by 1,311
Electronic Alerts to Prevent Venous Thromboembolism among Hospitalized Patients
Kucher, N., Koo, S., Quiroz, R., Cooper, J. M., Paterno, M. D., Soukonnikov, B., & Goldhaber, S. Z. (2005) · New England Journal of Medicine · doi:10.1056/nejmoa041533 · Cited by 942
Reminders to Physicians from an Introspective Computer Medical Record: A Two-Year Randomized Trial
McDONALD, C. J., HUI, S. L., SMITH, D. M., TIERNEY, W. M., COHEN, S. J., WEINBERGER, M., & McCABE, G. P. (1984) · Annals of Internal Medicine · doi:10.7326/0003-4819-100-1-130 · Cited by 625
A Computerized Reminder System to Increase the Use of Preventive Care for Hospitalized Patients
Dexter, P. R., Perkins, S., Overhage, J. M., Maharry, K., Kohler, R. B., & McDonald, C. J. (2001) · New England Journal of Medicine · doi:10.1056/nejmsa010181 · Cited by 519 · cited 5×
“…et al, 1993 (55) Overhage et al, 1996 (58) Burack et al, 1998 (45) Taylor et al, 1999 (60) Cannon and Allen, 2000 (47) Demakis et al, 2000 (48) Dexter et al, 2001b (49) Dexter et al, 2001a (49) Eccles et al, 2002 (51) Burack et al, 2003a (46) Burack et al, 2003b (46) Frank et al, 2004a…”
BackgroundInfluentialOwens, D. K., Lohr, K. N., Atkins, D., Treadwell, J. R., Reston, J. T., Bass, E. B., Chang, S., & Helfand, M. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.03.009 · Cited by 513
Research works printed but not linked: 29
- Bryan C, 2008, Inform Prim Care, 16, 79
- Gilutz H, 2009, Isr Med Assoc J, 11, 23
- McDonald CJ, 1992, MD Comput, 9, 304
- Frank O, 2004, Aust Fam Physician, 33, 87
- McDowell I, 1986, CMAJ, 135, 991
- McDowell I, 1989, J Fam Pract, 28, 420
- 10.1001/archinte.1996.00440130095010 · DOI · Paper page
- Price M, 2005, Can Fam Physician, 51, 1506
- Chambers CV, 1989, J Fam Pract, 29, 273
- Flanagan JR, 1999, Proc AMIA Symp, 755
- Fordham D, 1990, MD Comput, 7, 289
- 10.1001/archinte.1989.00390080116025 · doi:10.1001/archinte.1989.00390080116025 · Paper page
- Lobach DF, 1994, Proc Annu Symp Comput Appl Med Care, 787
- Ornstein SM, 1991, J Fam Pract, 32, 82
- Rosser WW, 1992, CMAJ, 146, 911
- Rosser WW, 1991, CMAJ, 145, 807
- Greiver M, 2005, Can Fam Physician, 51, 382
- Palen TE, 2006, Am J Manag Care, 12, 389
- Palen TE, 2010, Am J Manag Care, 16, 267
- Player MS, 2010, Qual Prim Care, 18, 223
- Schriefer SP, 2009, Fam Med, 41, 502
- Krall MA, 2004, Stud Health Technol Inform, 107, 135
- Locatelli F, 2009, J Nephrol, 22, 662
- Manotti C, 2001, Haematologica, 86, 1060
- Martens JD, 2006, Stud Health Technol Inform, 124, 617
- Peterson JF, 2007, Stud Health Technol Inform, 129, 1037
- Tamblyn R, 2003, CMAJ, 169, 549
- 10.1001/jama.1988.03720080028023 · doi:10.1001/jama.1988.03720080028023 · Paper page
- Smith DH, 2009, Am J Manag Care, 15, 281
Cited by
An overview of clinical decision support systems: Benefits, risks, and strategies for success
Sutton, R. T., Pincock, D., Baumgart, D. C., Sadowski, D. C., Fedorak, R. N., & Kroeker, K. I. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0221-y · Cited by 3,019
The Electronic Medical Records and Genomics (eMERGE) Network: past, present, and future
Gottesman, O., Kuivaniemi, H., Tromp, G., Faucett, W. A., Li, R., Manolio, T. A., Sanderson, S. C., Kannry, J., Zinberg, R., Basford, M. A., et al. (2013) · Genetics in Medicine · doi:10.1038/gim.2013.72 · Cited by 698
Johnson, M. J., & May, C. R. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-008592 · Cited by 513
Kwan, J. L., Lo, L., Ferguson, J., Goldberg, H., Diaz-Martinez, J. P., Tomlinson, G., Grimshaw, J. M., & Shojania, K. G. (2020) · BMJ · doi:10.1136/bmj.m3216 · Cited by 461
Clinical Decision-Support Systems
Musen, M. A., Middleton, B., & Greenes, R. A. (2014) · Biomedical Informatics · doi:10.1007/978-1-4471-4474-8_22 · Cited by 483
Metadata
- Authors
- Bright, T. J., Wong, A., Dhurjati, R., Bristow, E., Bastian, L., Coeytaux, R. R., Samsa, G., Hasselblad, V., Williams, J. W., Musty, M. D., Wing, L., Kendrick, A. S., Sanders, G. D., & Lobach, D.
- Affiliations
- Duke University (US)
- From Duke Evidence-based Practice Center, Duke Clinical Research Institute, Duke University School of Medicine, Durham, North Carolina, and School of Medicine, University of Utah, Salt Lake City, Utah.
- ORCID
- Venue
- Annals of Internal Medicine
- Publisher
- American College of Physicians
- Published
- 2012-07-03
- Volume
- 157
- Issue
- 1
- Pages
- 29-43
- ISSN
- 0003-4819 (ISSN-L)
- 1539-3704
- OpenAlex
- W2073924861
- Cited by
- 1,200
- References
- 175
- Citations by year
- 2026: 84 · 2025: 107 · 2024: 92 · 2023: 106 · 2022: 118 · 2021: 110 · 2020: 92 · 2019: 87 · 2018: 68 · 2017: 63 · 2016: 62 · 2015: 78 · 2014: 67 · 2013: 56 · 2012: 10
- FWCI
- 109.69
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.acpjournals.org/journal/aim/text-and-data-mining (tdm)
- Locations
- Annals of Internal Medicine (publishedVersion)
- PubMed (publishedVersion)
- Funders
- U.S. Public Health Service (290-2007-10066-I)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
- Keywords
- clinical decision support systems, electronic health records, preventive services, drug prescribing, clinical outcomes, health care costs, provider workload, patient satisfaction
- MeSH terms
- Cost-Benefit Analysis, Humans, Randomized Controlled Trials as Topic, Treatment Outcome, Decision Support Systems, Clinical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Effect of Clinical Decision-Support Systems: A Systematic Review. https://app.cochat.ai/papers/10.7326/0003-4819-157-1-201207030-00450
- The paper
- Bright, T. J., Wong, A., Dhurjati, R., Bristow, E., Bastian, L., Coeytaux, R. R., Samsa, G., Hasselblad, V., Williams, J. W., Musty, M. D., Wing, L., Kendrick, A. S., Sanders, G. D., & Lobach, D. (2012). Effect of Clinical Decision-Support Systems: A Systematic Review. Annals of Internal Medicine. https://doi.org/10.7326/0003-4819-157-1-201207030-00450
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.