Computer-based Guideline Implementation Systems: A Systematic Review of Functionality and Effectiveness
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
In this systematic review, the authors analyze the functionality provided by recent computer-based guideline implementation systems and characterize the effectiveness of the systems. Twenty-five studies published between 1992 and January 1998 were identified. Articles were included if the authors indicated an intent to implement guideline recommendations for clinicians and if the effectiveness of the system was evaluated. Provision of eight information management services and effects on guideline adherence, documentation, user satisfaction, and patient outcome were noted. All systems provided patient-specific recommendations. In 19, recommendations were available concurrently with care. Explanation services were described for nine systems. Nine systems allowed interactive documentation, and 17 produced paper-based output. Communication services were present most often in systems integrated with electronic medical records. Registration, calculation, and aggregation services were infrequently reported. There were 10 controlled trials (9 randomized) and 10 time-series correlational studies. Guideline adherence improved in 14 of 18 systems in which it was measured. Documentation improved in 4 of 4 studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations
Grimshaw, J. M., & Russell, I. T. (1993) · The Lancet · doi:10.1016/0140-6736(93)92244-n · Cited by 2,770
The Biomedical Engineering Handbook
Bronzino, J. D., & Peterson, D. R. (2018) · CRC Press eBooks · doi:10.1201/b18423 · Cited by 1,599
Do Practice Guidelines Guide Practice?
Lomas, J., Anderson, G. M., Domnick-Pierre, K., Vayda, E., Enkin, M. W., & Hannah, W. J. (1989) · New England Journal of Medicine · doi:10.1056/nejm198911093211906 · Cited by 1,234
(1997) · Europe PMC (PubMed Central) · Cited by 1,226
Changing Physicians' Practices
Greco, P. J., & Eisenberg, J. M. (1993) · New England Journal of Medicine · doi:10.1056/nejm199310213291714 · Cited by 977
Johnston, M. E., Langton, K. B., Haynes, R. B., & Mathieu, A. (1994) · Annals of Internal Medicine · doi:10.7326/0003-4819-120-2-199401150-00007 · Cited by 714
Adverse outcomes of underuse of beta-blockers in elderly survivors of acute myocardial infarction
Soumerai, S. B. (1997) · JAMA · doi:10.1001/jama.277.2.115 · Cited by 486
An analysis of physician attitudes regarding computer-based clinical consultation systems
Teach, R. L., & Shortliffe, E. H. (1981) · Computers and Biomedical Research · doi:10.1016/0010-4809(81)90012-4 · Cited by 328
Lobach, D. F., & Hammond, W. E. (1997) · The American Journal of Medicine · doi:10.1016/s0002-9343(96)00382-8 · Cited by 303
Litzelman, D. K., Dittus, R. S., Miller, M. E., & Tierney, W. M. (1993) · Journal of General Internal Medicine · doi:10.1007/bf02600144 · Cited by 236
Cited by
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
Kawamoto, K., Houlihan, C. A., Balas, E. A., & Lobach, D. F. (2005) · BMJ · doi:10.1136/bmj.38398.500764.8f · Cited by 2,703
The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview
Black, A. D., Car, J., Pagliari, C., Anandan, C., Cresswell, K., Bokun, T., McKinstry, B., Procter, R., Majeed, A., & Sheikh, A. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1000387 · Cited by 1,442
Automation bias: a systematic review of frequency, effect mediators, and mitigators
Goddard, K., Roudsari, A., & Wyatt, J. C. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000089 · Cited by 1,162
Jaspers, M. W. M., Smeulers, M., Vermeulen, H., & Peute, L. W. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000094 · Cited by 525
IT support for healthcare processes – premises, challenges, perspectives
Lenz, R., & Reichert, M. (2007) · Data & Knowledge Engineering · doi:10.1016/j.datak.2006.04.007 · Cited by 521
Prior, M., Guerin, M., & Grimmer‐Somers, K. (2008) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2008.01014.x · Cited by 507
Costs and benefits of health information technology.
Shekelle, P. G., Morton, S. C., & Keeler, E. B. (2006) · doi:10.23970/ahrqepcerta132 · Cited by 501
On being ‘Systematic’ in Literature Reviews in IS
Boell, S. K., & Cecez-Kecmanovic, D. (2015) · Journal of Information Technology · doi:10.1057/jit.2014.26 · Cited by 485
Shiffman, R. N., Dixon, J., Brandt, C., Essaihi, A., Hsiao, A., Michel, G., & O'Connell, R. (2005) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-5-23 · Cited by 389
Self-citationEvaluating informatics applications – clinical decision support systems literature review
Kaplan, B. (2001) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(01)00183-6 · Cited by 350
Bennett, J. W., & Glasziou, P. P. (2003) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2003.tb05166.x · Cited by 146
Oluoch, T., Santas, X., Kwaro, D., Were, M., Biondich, P., Bailey, C., Abu-Hanna, A., & de Keizer, N. (2012) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2012.07.010 · Cited by 120
Human Factors Barriers to the Effective Use of Ten HIV Clinical Reminders
Patterson, E. S., Nguyen, A. D., Halloran, J. P., & Asch, S. M. (2004) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1364 · Cited by 115
Wells, S., Furness, S., Rafter, N., Horn, E., Whittaker, R., Stewart, A., Moodabe, K., Roseman, P., Selak, V., Bramley, D., et al. (2008) · European Journal of Cardiovascular Prevention & Rehabilitation · doi:10.1097/hjr.0b013e3282f13af4 · Cited by 109
the eCRT Research Team, McDermott, L., Yardley, L., Little, P., Ashworth, M., & Gulliford, M. (2010) · BMC Family Practice · doi:10.1186/1471-2296-11-90 · Cited by 62
Sintchenko, V., Magrabi, F., & Tipper, S. (2007) · Medical Informatics and the Internet in Medicine · doi:10.1080/14639230701447701 · Cited by 47
Metadata
- Authors
- Shiffman, R. N., Liaw, Y., Brandt, C. A., & Corb, G. J.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 1999-03-01
- Volume
- 6
- Issue
- 2
- Pages
- 104-114
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W2275899958
- Cited by
- 333
- References
- 33
- FWCI
- 2.83
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.