Effects of computerized decision support system implementations on patient outcomes in inpatient care: a systematic review
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Objectives: To systematically classify the clinical impact of computerized clinical decision support systems (CDSSs) in inpatient care. Materials and Methods: Medline, Cochrane Trials, and Cochrane Reviews were searched for CDSS studies that assessed patient outcomes in inpatient settings. For each study, 2 physicians independently mapped patient outcome effects to a predefined medical effect score to assess the clinical impact of reported outcome effects. Disagreements were measured by using weighted kappa and solved by consensus. An example set of promising disease entities was generated based on medical effect scores and risk of bias assessment. To summarize technical characteristics of the systems, reported input variables and algorithm types were extracted as well. Results: Seventy studies were included. Five (7%) reported reduced mortality, 16 (23%) reduced life-threatening events, and 28 (40%) reduced non–life-threatening events, 20 (29%) had no significant impact on patient outcomes, and 1 showed a negative effect (weighted κ: 0.72, P < .001). Six of 24 disease entity settings showed high effect scores with medium or low risk of bias: blood glucose management, blood transfusion management, physiologic deterioration prevention, pressure ulcer prevention, acute kidney injury prevention, and venous thromboembolism prophylaxis. Most of the implemented algorithms (72%) were rule-based. Reported input variables are shared as standardized models on a metadata repository. Discussion and Conclusion: Most of the included CDSS studies were associated with positive patient outcomes effects but with substantial differences regarding the clinical impact. A subset of 6 disease entities could be filtered in which CDSS should be given special consideration at sites where computer-assisted decision-making is deemed to be underutilized. Registration number on PROSPERO: CRD42016049946.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Interrater reliability: The kappa statistic
McHugh, M. L. (2012) · Biochemia Medica · doi:10.11613/bm.2012.031 · Cited by 19,877
Effect of Clinical Decision-Support Systems: A Systematic Review
Bright, T. J., Wong, A., Dhurjati, R., Bristow, E., Bastian, L., Coeytaux, R. R., Samsa, G., Hasselblad, V., Williams, J. W., Musty, M. D., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-1-201207030-00450 · Cited by 1,200
Mackay, D. J. C. (1995) · Network Computation in Neural Systems · doi:10.1088/0954-898x/6/3/011 · Cited by 915
Publication bias in clinical trials due to statistical significance or direction of trial results
Hopewell, S., Loudon, K., Clarke, M. J., Oxman, A. D., & Dickersin, K. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000006.pub3 · Cited by 898 · cited 1×
“Strengths and limitations As with all reviews, selective outcome reporting or publication bias is a given, since positive outcome effects are more likely to be published than nonsignificant or negative ones.(69) Additionally, we relied on the publication standards of the journals to rule out studies with financial dep…”
MethodGrand challenges in clinical decision support
Sittig, D. F., Wright, A., Osheroff, J. A., Middleton, B., Teich, J. M., Ash, J. S., Campbell, E., & Bates, D. W. (2008) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2007.09.003 · Cited by 582
Health Information Technology: An Updated Systematic Review With a Focus on Meaningful Use
Jones, S. S., Rudin, R. S., Perry, T., & Shekelle, P. G. (2014) · Annals of Internal Medicine · doi:10.7326/m13-1531 · Cited by 475
Reasons or excuses for avoiding meta-analysis in forest plots
Ioannidis, J. P. A., Patsopoulos, N. A., & Rothstein, H. R. (2008) · BMJ · doi:10.1136/bmj.a117 · Cited by 457
Impact of a hypoglycemia reduction bundle and a systems approach to inpatient glycemic management
Maynard, G., Kulasa, K., Ramos, P., Childers, D., Clay, B., Sebasky, M., Fink, E., Field, A., Renvall, M., Juang, P. S., et al. (2015) · Endocrine Practice · doi:10.4158/ep14367.or · Cited by 52 · cited 1×
“For instance, an insulin dosing system that could potentially suggest overdosing could be coupled with a hypoglycemia bundle to prevent potentially life-threatening hypoglycemic events.(36) Before running the CDSS in the real-world setting, on-site promotion, education, and training of system users could raise the awa…”
BackgroundSaur, N. M., Kongable, G. L., Holewinski, S., O’Brien, K., & Nasraway, S. A. (2013) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2013.07.003 · Cited by 37
Cited by
Machine learning in clinical decision making
Adlung, L., Cohen, Y., Mor, U., & Elinav, E. (2021) · Med · doi:10.1016/j.medj.2021.04.006 · Cited by 282
Vasey, B., Ursprung, S., Beddoe, B., Taylor, E. H., Marlow, N., Bilbro, N., Watkinson, P., & McCulloch, P. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.1276 · Cited by 154
Chaparro, J. D., Beus, J. M., Dziorny, A. C., Hagedorn, P. A., Hernandez, S., Kandaswamy, S., Kirkendall, E. S., McCoy, A. B., Muthu, N., & Orenstein, E. W. (2022) · Applied Clinical Informatics · doi:10.1055/s-0042-1748856 · Cited by 76
Muylle, K. M., Gentens, K., Dupont, A. G., & Cornu, P. (2021) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2021.104393 · Cited by 45
Tao, L., Zhang, C., Zeng, L., Zhu, S., Li, N., Li, W., Zhang, H., Zhao, Y., Zhan, S., & Ji, H. (2020) · JMIR Medical Informatics · doi:10.2196/16912 · Cited by 42
“CDSS have been used for more than 50 years [14]; many have commented on its positive impact on diagnostic quality and patient safety [15-18] and ability to promote optimal treatments [19] and avoid medical errors [20,21].”
Background
Metadata
- Authors
- Varghese, J., Kleine, M., Gessner, S. I., Sandmann, S., & Dugas, M.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-09-23
- Volume
- 25
- Issue
- 5
- Pages
- 593-602
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W2759452227
- Cited by
- 132
- References
- 9
- FWCI
- 2.36
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.