The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Effects of evidence-based clinical practice guidelines on quality of care: a systematic review
Abstract
BACKGROUND: Evidence-based clinical guidelines aim to improve the quality of care. In The Netherlands, considerable time and effort have been invested in the development and implementation of evidence-based guidelines since the 1990s. Thus far, no reviews are available on their effectiveness. The primary aim of this article was to assess the evidence for the effectiveness of Dutch evidence-based clinical guidelines in improving the quality of care. METHODS: A systematic review of studies evaluating the effects of Dutch evidence-based guidelines on both the process and structure of care and patient outcomes was conducted. The electronic databases Medline and Embase (1990-2007) and relevant scientific journals were searched. Studies were only selected if they included a controlled trial, an interrupted time series design or a before and after design. RESULTS: A total of 20 studies were included. In 17 of 19 studies that measured the effects on the process or structure of care, significant improvements were reported. Thirteen of these studies reported improvement with respect to some of the recommendations studied. In addition, the size of the observed effects varied largely across the recommendations within guidelines. Six of nine studies that measured patient health outcomes showed significant but small improvements as a result of the use of clinical guidelines. CONCLUSIONS: This review demonstrates that Dutch evidence-based clinical guidelines can be effective in improving the process and structure of care. The effects of guidelines on patient health outcomes were studied far less and data are less convincing. The high level of variation in effects across recommendations suggests that implementation strategies tailored to individual recommendations within the guideline are needed to establish relevant improvements in healthcare. Moreover, the results highlight the need for well-designed studies focusing on the level of the recommendations to determine which factors influence guideline utilisation and improved patient outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · An Integrated Approach to Communication Theory and Research · doi:10.4324/9780203710753-35 · Cited by 37,322
Evaluating the quality of medical care
DONABEDIAN, A. (2005) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2005.00397.x · Cited by 6,102 · cited 1×
“To evaluate effects on quality of care, we used Donabedian’s model, which distinguished the structure, processes and outcomes of care.(20) Structure of care refers to ‘‘human, physical and financial resources that are needed to provide medical care’’ (eg, the presence of spirometry in general practice).”
MethodEffectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., et al. (2004) · Health Technology Assessment · doi:10.3310/hta8060 · Cited by 3,044
Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations
Grimshaw, J. M., & Russell, I. T. (1993) · The Lancet · doi:10.1016/0140-6736(93)92244-n · Cited by 2,770
The definition of quality and approaches to its assessment
Donabedian, A. (1980) · Health Administration Press eBooks · Cited by 1,747
(2003) · Quality and Safety in Health Care · doi:10.1136/qhc.12.1.18 · Cited by 1,446
Clinical practice guidelines : directions for a new program
Field, M. J., & Lohr, K. N. (1990) · Cited by 1,415
Clinical guidelines: Developing guidelines
Shekelle, P. G., Woolf, S. H., Eccles, M., & Grimshaw, J. (1999) · BMJ · doi:10.1136/bmj.318.7183.593 · Cited by 1,222
Grol, R., Dalhuijsen, J., Thomas, S., Veld, C. I. ‘., Rutten, G., & Mokkink, H. (1998) · BMJ · doi:10.1136/bmj.317.7162.858 · Cited by 877
Grimshaw, J., Eccles, M., Thomas, R., MacLennan, G., Ramsay, C., Fraser, C., & Vale, L. (2006) · Journal of General Internal Medicine · doi:10.1007/s11606-006-0269-7 · Cited by 631
Improving Patient Care: The Implementation of Change in Clinical Practice
Grol, R. P. T. M., Wensing, M., Eccles, M., Davis, D., & Wensign, M. (2005) · Cited by 553
Implementing clinical guidelines: Current evidence and future implications
Grimshaw, J., Eccles, M., & Tetroe, J. (2004) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.1340240506 · Cited by 487
Developing and implementing clinical practice guidelines.
Grimshaw, J., Freemantle, N., Wallace, S., Russell, I., Hurwitz, B., Watt, I., Long, A., & Sheldon, T. (1995) · Quality in Health Care · doi:10.1136/qshc.4.1.55 · Cited by 469
A systematic review of the role of bisphosphonates in metastatic disease
Ross, J., Saunders, Y., Edmonds, P., Patel, S., Wonderling, D., Normand, C., & Broadley, K. (2004) · Health Technology Assessment · doi:10.3310/hta8040 · Cited by 467
QUOROM Group, Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (2000) · Journal of British Surgery · doi:10.1046/j.1365-2168.2000.01610.x · Cited by 416
Grilli, R., & Lomas, J. (1994) · Medical Care · doi:10.1097/00005650-199403000-00002 · Cited by 392
Towards evidence-based clinical practice: an international survey of 18 clinical guideline programs
BURGERS, J. S. (2003) · International Journal for Quality in Health Care · doi:10.1093/intqhc/15.1.31 · Cited by 331
Self-citationSystematic reviews of the effectiveness of quality improvement strategies and programmes
Grimshaw, J. (2003) · Quality and Safety in Health Care · doi:10.1136/qhc.12.4.298 · Cited by 292
Worrall, G. J., Chaulk, P. C., & Freake, D. (1997) · Europe PMC (PubMed Central) · Cited by 252
Physicians' Internet information-seeking behaviors
Bennett, N. L., Casebeer, L. L., Kristofco, R. E., & Strasser, S. M. (2004) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.1340240106 · Cited by 237
Characteristics of effective clinical guidelines for general practice.
Burgers, J. S., Grol, R. P. T. M., Zaat, J. O. M., Spies, T. H., van der Bij, A. K., & Mokkink, H. G. A. (2003) · Europe PMC (PubMed Central) · Cited by 182
Self-citationBekkering, G. E., van Tulder, M. W., Hendriks, E. J., Koopmanschap, M. A., Knol, D. L., Bouter, L. M., & Oostendorp, R. A. (2005) · Physical Therapy · doi:10.1093/ptj/85.6.544 · Cited by 141
Bekkering, G. E. (2005) · Quality and Safety in Health Care · doi:10.1136/qshc.2003.009357 · Cited by 138
van Kasteren, M. E. E., Manniën, J., Kullberg, B. J., de Boer, A. S., Nagelkerke, N. J. D., Ridderhof, M., Wille, J. C., & Gyssens, I. C. (2005) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dki374 · Cited by 135
Twenty years of implementation research
Grol, R. P. T. M. (2000) · Family Practice · doi:10.1093/fampra/17.suppl_1.s32 · Cited by 129
Eisinger, F., Geller, G., Burke, W., & Holtzman, N. A. (1999) · The Lancet · doi:10.1016/s0140-6736(98)07516-3 · Cited by 127
Renders, C., Valk, G. D., Franse, L. V., Schellevis, F., van Eijk, J., & van der Wal, G. (2001) · Diabetes Care · doi:10.2337/diacare.24.8.1365 · Cited by 127
Engers, A. J., Wensing, M., van Tulder, M. W., Timmermans, A., Oostendorp, R. A. B., Koes, B. W., & Grol, R. (2005) · Spine · doi:10.1097/01.brs.0000155406.79479.3a · Cited by 113
de Laat, E. H., Pickkers, P., Schoonhoven, L., Verbeek, A. L. M., Feuth, T. B., & van Achterberg, T. (2007) · Critical Care Medicine · doi:10.1097/01.ccm.0000257072.10313.56 · Cited by 106
GUIDELINE DEVELOPMENT IN EUROPE An International Comparison
(2000) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462300103101 · Cited by 98
Schouten, J. A., Hulscher, M., Liefers, J., Akkermans, R., Kullberg, B. J., Grol, R. P. T. M., & van der Meer, J. W. M. (2007) · Clinical Infectious Diseases · doi:10.1086/512193 · Cited by 73
Frijling, B. D., Lobo, C. M., Hulscher, M., Akkermans, R., Braspenning, J. C. C., Prins, A., van der Wouden, J. C., & Grol, R. P. T. M. (2002) · Diabetic Medicine · doi:10.1046/j.1464-5491.2002.00810.x · Cited by 65
Hulscher, M., Drenth, B. B. V., van der Wouden, J. C., Mokkink, H. G. A., van Weel, C., & Grol, R. P. T. M. (1997) · BMJ Quality & Safety · doi:10.1136/qshc.6.1.19 · Cited by 58
Smeele, I. J. M., Grol, R. P. T. M., van Schayck, O. C. P., van den Bosch, W. J., van den Hoogen, H. J., & Muris, J. W. M. (1999) · BMJ Quality & Safety · doi:10.1136/qshc.8.2.92 · Cited by 57
van der Sanden, W. J. M., Mettes, D. G., Plasschaert, A. J. M., Grol, R. P. T. M., Mulder, J., & Verdonschot, E. H. (2005) · European Journal Of Oral Sciences · doi:10.1111/j.1600-0722.2005.00232.x · Cited by 55
Organizational Predictors of Adherence to Ambulatory Care Screening Guidelines
Vaughn, T. E., McCoy, K. D., BootsMiller, B. J., Woolson, R. F., Sorofman, B. A., Tripp‐Reimer, T., Perlin, J. A., & Doebbeling, B. N. (2002) · Medical Care · doi:10.1097/00005650-200212000-00005 · Cited by 51
van der Weijden, T., Grol, R. P. T. M., & Knottnerus, J. A. (1999) · International Journal for Quality in Health Care · doi:10.1093/intqhc/11.2.131 · Cited by 50
(2001) · Europe PMC (PubMed Central) · Cited by 49
Jans, M. P., Schellevis, F. G., Coq, E. M. L., Bezemer, P. D., & van Eijk, J. T. (2001) · International Journal for Quality in Health Care · doi:10.1093/intqhc/13.1.17 · Cited by 46
Implementation of a new policy results in a decrease of pressure ulcer frequency
de Laat, E. H., Schoonhoven, L., Pickkers, P., Verbeek, A. L. M., & van Achterberg, T. (2005) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzi088 · Cited by 46
Frijling, B. D., Lobo, C. M., Hulscher, M. E. J. L., Akkermans, R. P., van Drenth, B. B., Prins, A., van der Wouden, J. C., & Grol, R. P. T. M. (2003) · BMJ Quality & Safety · doi:10.1136/qhc.12.3.181 · Cited by 46
Lobo, C. M., Frijling, B. D., Hulscher, M., Bernsen, R. M. D., Braspenning, J. C. C., Grol, R. P. T. M., Prins, A., & van der Wouden, J. C. (2002) · Preventive Medicine · doi:10.1006/pmed.2002.1095 · Cited by 43
Hak, R. P. M. G. H. E. (2000) · Scandinavian Journal of Primary Health Care · doi:10.1080/028134300448814 · Cited by 40
Frijling, B. D., Hulscher, M., van Leest, L., Braspenning, J. C. C., van den Hoogen, H., Drenthen, A. J. M., & Grol, R. P. T. M. (2003) · Europe PMC (PubMed Central) · Cited by 38
van Essen, G. A., Kuyvenhoven, M. M., & MELKER, R. A. D. (1997) · PubMed · Cited by 33
Kasje, W. N., Denig, P., Stewart, R. E., de Graeff, P. A., & Haaijer‐Ruskamp, F. M. (2005) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2005.00625.x · Cited by 31
Lobo, C. M., Frijling, B. D., Hulscher, M., Bernsen, R. M. D., Grol, R. P. T. M., Prins, A., & van der Wouden, J. C. (2004) · Quality of Life Research · doi:10.1023/b:qure.0000015285.08673.42 · Cited by 23
Hermens, R., Hak, E., Hulscher, M., Mulder, J., Tacken, M. C. T., Braspenning, J. C. C., & Grol, R. P. T. M. (1999) · International Journal for Quality in Health Care · doi:10.1093/intqhc/11.3.193 · Cited by 19
Jans, M. P., Schellevis, F., van Hensbergen, W., & van Eijk, J. T. M. (2000) · PubMed · Cited by 17
Effects of distance learning on clinical management of LUTS in primary care: a randomised trial
Wolters, R. J., Wensing, M., Klomp, M., Lagro-Jansen, T., van Weel, C., & Grol, R. P. T. M. (2004) · Patient Education and Counseling · doi:10.1016/j.pec.2004.11.009 · Cited by 10
Cited by
Barriers and Strategies in Guideline Implementation—A Scoping Review
Fischer, F., Lange, K., Klose, K., Greiner, W., & Kraemer, A. (2016) · Healthcare · doi:10.3390/healthcare4030036 · Cited by 900
Lugtenberg, M., Zegers-van Schaick, J. M., Westert, G. P., & Burgers, J. S. (2009) · Implementation Science · doi:10.1186/1748-5908-4-54 · Cited by 478
Self-citationMethods of Formal Consensus in Classification/Diagnostic Criteria and Guideline Development
Nair, R., Aggarwal, R., & Khanna, D. (2011) · Seminars in Arthritis and Rheumatism · doi:10.1016/j.semarthrit.2010.12.001 · Cited by 438
Squires, J. E., Sullivan, K., Eccles, M. P., Worswick, J., & Grimshaw, J. M. (2014) · Implementation Science · doi:10.1186/s13012-014-0152-6 · Cited by 368
Dhaliwal, R., Cahill, N., Lemieux, M., & Heyland, D. K. (2014) · Nutrition in Clinical Practice · doi:10.1177/0884533613510948 · Cited by 282
Metadata
- Authors
- Lugtenberg, M., Burgers, J. S., & Westert, G. P.
- Venue
- Quality and Safety in Health Care
- Publisher
- BMJ
- Published
- 2009-10-01
- Volume
- 18
- Issue
- 5
- Pages
- 385-392
- ISSN
- 1475-3898 (ISSN-L)
- 1475-3901
- OpenAlex
- W2161511809
- Cited by
- 478
- References
- 51
- FWCI
- 2.94
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.