Computer-based Guideline Implementation Systems: A Systematic Review of Functionality and Effectiveness
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
In this systematic review, the authors analyze the functionality provided by recent computer-based guideline implementation systems and characterize the effectiveness of the systems. Twenty-five studies published between 1992 and January 1998 were identified. Articles were included if the authors indicated an intent to implement guideline recommendations for clinicians and if the effectiveness of the system was evaluated. Provision of eight information management services and effects on guideline adherence, documentation, user satisfaction, and patient outcome were noted. All systems provided patient-specific recommendations. In 19, recommendations were available concurrently with care. Explanation services were described for nine systems. Nine systems allowed interactive documentation, and 17 produced paper-based output. Communication services were present most often in systems integrated with electronic medical records. Registration, calculation, and aggregation services were infrequently reported. There were 10 controlled trials (9 randomized) and 10 time-series correlational studies. Guideline adherence improved in 14 of 18 systems in which it was measured. Documentation improved in 4 of 4 studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations
Grimshaw, J. M., & Russell, I. T. (1993) · The Lancet · doi:10.1016/0140-6736(93)92244-n · Cited by 2,770
The Biomedical Engineering Handbook
Bronzino, J. D., & Peterson, D. R. (2018) · CRC Press eBooks · doi:10.1201/b18423 · Cited by 1,599
Do Practice Guidelines Guide Practice?
Lomas, J., Anderson, G. M., Domnick-Pierre, K., Vayda, E., Enkin, M. W., & Hannah, W. J. (1989) · New England Journal of Medicine · doi:10.1056/nejm198911093211906 · Cited by 1,234
(1997) · Europe PMC (PubMed Central) · Cited by 1,226
Changing Physicians' Practices
Greco, P. J., & Eisenberg, J. M. (1993) · New England Journal of Medicine · doi:10.1056/nejm199310213291714 · Cited by 977
Johnston, M. E., Langton, K. B., Haynes, R. B., & Mathieu, A. (1994) · Annals of Internal Medicine · doi:10.7326/0003-4819-120-2-199401150-00007 · Cited by 714
Adverse outcomes of underuse of beta-blockers in elderly survivors of acute myocardial infarction
Soumerai, S. B. (1997) · JAMA · doi:10.1001/jama.277.2.115 · Cited by 486
An analysis of physician attitudes regarding computer-based clinical consultation systems
Teach, R. L., & Shortliffe, E. H. (1981) · Computers and Biomedical Research · doi:10.1016/0010-4809(81)90012-4 · Cited by 328
Lobach, D. F., & Hammond, W. E. (1997) · The American Journal of Medicine · doi:10.1016/s0002-9343(96)00382-8 · Cited by 303
Litzelman, D. K., Dittus, R. S., Miller, M. E., & Tierney, W. M. (1993) · Journal of General Internal Medicine · doi:10.1007/bf02600144 · Cited by 236
Dexter, P. R., Wolinsky, F. D., Gramelspacher, G. P., Zhou, X.-H., Eckert, G. J., Waisburd, M., & Tierney, W. M. (1998) · Annals of Internal Medicine · doi:10.7326/0003-4819-128-2-199801150-00005 · Cited by 190
Computer Reminders to Implement Preventive Care Guidelines for Hospitalized Patients
Overhage, J. M. (1996) · Archives of Internal Medicine · doi:10.1001/archinte.156.14.1551 · Cited by 156
Guidelines for management of HIV infection with computer-based patient's record
Safran, C., Rind, D. M., Davis, R. B., Ives, D., Sands, D. Z., Currier, J. S., Slack, W. V., Makadon, H. J., & Cotton, D. J. (1995) · The Lancet · doi:10.1016/s0140-6736(95)92226-1 · Cited by 143
Schriger, D. L. (1997) · JAMA · doi:10.1001/jama.278.19.1585 · Cited by 114
Burack, R. C., Gimotty, P. A., George, J., Stengle, W., Warbasse, L., & Moncrease, A. (1994) · Medical Care · doi:10.1097/00005650-199406000-00006 · Cited by 95
Nilasena, D. S., & Lincoln, M. J. (1995) · PubMed · Cited by 91
Computerized medical records and preventive health care: Success depends on many factors
Tape, T. G., & Campbell, J. R. (1993) · The American Journal of Medicine · doi:10.1016/0002-9343(93)90214-a · Cited by 85
A computerized intervention to decrease the use of calcium channel blockers in hypertension
Rossi, R. A., & Every, N. R. (1997) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.1997.07140.x · Cited by 71
Burack, R. C., & Gimotty, P. A. (1997) · Medical Care · doi:10.1097/00005650-199709000-00005 · Cited by 61
Mourad, J. (1997) · La Revue de Médecine Interne · doi:10.1016/s0248-8663(97)82517-9 · Cited by 60
Computerized algorithms and pediatriciansʼ management of common problems in a community clinic
Margolis, C. Z., Warshawsky, S. S., Goldman, L., Dagan, O. C., Wirtschafter, D. D., & Pliskin, J. S. (1992) · Academic Medicine · doi:10.1097/00001888-199204000-00021 · Cited by 41
Turner, R. C. (1994) · Archives of Internal Medicine · doi:10.1001/archinte.154.17.1957 · Cited by 38
Implementation and evaluation of a computer-based preventive services system.
Sm, O., Dr, G., Rg, J., Musham, C., Hamadeh, G. N., & Lancaster, C. (1995) · PubMed · Cited by 35
Day, F. C., Hoang, L. P., Ouk, S., Nagda, S., & Schriger, D. L. (1995) · PubMed Central · Cited by 30
Clinical Practice Guidelines: The Role of Technology in Perspective
Elson, R. B. (1997) · Disease Management & Health Outcomes · doi:10.2165/00115677-199701020-00001 · Cited by 25
Computerized support of pressure ulcer prevention and treatment protocols.
Willson, D., Ashton, C., Wingate, N., Goff, C., Horn, S. D., Davies, M., & Buxton, R. (1995) · PubMed · Cited by 24
Ornstein, S. M., Garr, D. R., & Jenkins, R. (1993) · PubMed · Cited by 24
Zielstorff, R. D., Estey, G. A., Vickery, A. W., Hamilton, G., Fitzmaurice, J. B., & Barnett, G. O. (1997) · PubMed · Cited by 17
Development and implementation of a computer-generated reminder system for diabetes preventive care.
Nilasena, D. S., Lincoln, M. J., Turner, C. W., Warner, H. R., Foerster, V., Williamson, J. W., & Stults, B. M. (1994) · PubMed Central · Cited by 15
A decision support system for prevention and treatment of pressure ulcers based on AHCPR guidelines.
Zielstorff, R. D., Barnett, G. O., Fitzmaurice, J. B., Estey, G. A., Hamilton, G., Vickery, A. W., Welebob, E. M., & Shahzad, C. (1996) · PubMed Central · Cited by 14
Physician compliance with practice guidelines.
Goethe, J. W., Schwartz, H. I., & Szarek, B. L. (1997) · PubMed · Cited by 10
Vincent, E. C., Hardin, P. A., Norman, L. A., Lester, E. A., & Stinton, S. H. (1995) · PubMed Central · Cited by 10
Lipid management program: results of applying national guidelines in a private practice.
Robbins, J., DICKINSON, W. A., Bartel, A. G., & Hartman, C. W. (1993) · PubMed · Cited by 4
Cited by
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
Kawamoto, K., Houlihan, C. A., Balas, E. A., & Lobach, D. F. (2005) · BMJ · doi:10.1136/bmj.38398.500764.8f · Cited by 2,703
The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview
Black, A. D., Car, J., Pagliari, C., Anandan, C., Cresswell, K., Bokun, T., McKinstry, B., Procter, R., Majeed, A., & Sheikh, A. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1000387 · Cited by 1,442
Automation bias: a systematic review of frequency, effect mediators, and mitigators
Goddard, K., Roudsari, A., & Wyatt, J. C. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000089 · Cited by 1,162
Jaspers, M. W. M., Smeulers, M., Vermeulen, H., & Peute, L. W. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000094 · Cited by 525
Metadata
- Authors
- Shiffman, R. N., Liaw, Y., Brandt, C. A., & Corb, G. J.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 1999-03-01
- Volume
- 6
- Issue
- 2
- Pages
- 104-114
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W2275899958
- Cited by
- 333
- References
- 33
- FWCI
- 2.83
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.