Tools developed and disseminated by guideline producers to promote the uptake of their guidelines
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The uptake of clinical practice guidelines (CPGs) is inconsistent, despite their potential to improve the quality of health care and patient outcomes. Some guideline producers have addressed this problem by developing tools to encourage faster adoption of new guidelines. This review focuses on the effectiveness of tools developed and disseminated by guideline producers to improve the uptake of their CPGs. OBJECTIVES: To evaluate the effectiveness of implementation tools developed and disseminated by guideline producers, which accompany or follow the publication of a CPG, to promote uptake. A secondary objective is to determine which approaches to guideline implementation are most effective. SEARCH METHODS: We searched the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register, Cochrane Central Register of Controlled Trials (CENTRAL); NHS Economic Evaluation Database, HTA Database; MEDLINE and MEDLINE In-Process and other non-indexed citations; Embase; PsycINFO; CINAHL; Dissertations and Theses, ProQuest; Index to Theses; Science Citation Index Expanded, ISI Web of Knowledge; Conference Proceedings Citation Index - Science, ISI Web of Knowledge; Health Management Information Consortium (HMIC), and NHS Evidence up to February 2016. We also searched trials registers, reference lists of included studies and relevant websites. SELECTION CRITERIA: We included randomised controlled trials (RCTs) and cluster-RCTs, controlled before-and-after studies (CBAs) and interrupted time series (ITS) studies evaluating the effects of guideline implementation tools developed by recognised guideline producers to improve the uptake of their own guidelines. The guideline could target any clinical area. DATA COLLECTION AND ANALYSIS: Two review authors independently extracted data and assessed the risk of bias of each included study using the Cochrane 'Risk of bias' criteria. We graded our confidence in the evidence using the approach recommended by the GRADE working group. The clinical conditions targeted and the implementation tools used were too heterogenous to combine data for meta-analysis. We report the median absolute risk difference (ARD) and interquartile range (IQR) for the main outcome of adherence to guidelines. MAIN RESULTS: We included four cluster-RCTs that were conducted in the Netherlands, France, the USA and Canada. These studies evaluated the effects of tools developed by national guideline producers to implement their CPGs. The implementation tools evaluated targeted healthcare professionals; none targeted healthcare organisations or patients.One study used two short educational workshops tailored to barriers. In three studies the intervention consisted of the provision of paper-based educational materials, order forms or reminders, or both. The clinical condition, type of healthcare professional, and behaviour targeted by the CPG varied across studies.Two of the four included studies reported data on healthcare professionals' adherence to guidelines. A guideline tool developed by the producers of a guideline probably leads to increased adherence to the guidelines; median ARD (IQR) was 0.135 (0.115 and 0.159 for the two studies respectively) at an average four-week follow-up (moderate certainty evidence), which indicates a median 13.5% greater adherence to guidelines in the intervention group. Providing healthcare professionals with a tool to improve implementation of a guideline may lead to little or no difference in costs to the health service. AUTHORS' CONCLUSIONS: Implementation tools developed by recognised guideline producers probably lead to improved healthcare professionals' adherence to guidelines in the management of non-specific low back pain and ordering thyroid-function tests. There are limited data on the relative costs of implementing these interventions.There are no studies evaluating the effectiveness of interventions targeting the organisation of care (e.g. benchmarking tools, costing templates, etc.), or for mass media interventions. We could not draw any conclusions about our second objective, the comparative effectiveness of implementation tools, due to the small number of studies, the heterogeneity between interventions, and the clinical conditions that were targeted.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables
Guyatt, G., Oxman, A. D., Akl, E. A., Kunz, R., Vist, G., Brozek, J., Norris, S., Falck-Ytter, Y., Glasziou, P., & deBeer, H. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.026 · Cited by 10,681
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Self-citationFrom best evidence to best practice: effective implementation of change in patients' care
Grol, R., & Grimshaw, J. (2003) · The Lancet · doi:10.1016/s0140-6736(03)14546-1 · Cited by 4,531
Self-citationAGREE II: advancing guideline development, reporting and evaluation in health care
Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., Fervers, B., Graham, I. D., Grimshaw, J., Hanna, S. E., et al. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.090449 · Cited by 3,790
Self-citationEffectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., et al. (2004) · Health Technology Assessment · doi:10.3310/hta8060 · Cited by 3,044
Self-citationWelcome to Implementation Science
Eccles, M. P., & Mittman, B. S. (2006) · Implementation Science · doi:10.1186/1748-5908-1-1 · Cited by 2,254
Self-citationForsetlund, L., Bjørndal, A., Rashidian, A., Jamtvedt, G., O'Brien, M. A., Wolf, F. M., Davis, D., Odgaard-Jensen, J., & Oxman, A. D. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003030.pub2 · Cited by 1,849
Davis, D. A. (1995) · JAMA · doi:10.1001/jama.1995.03530090032018 · Cited by 1,763
Educational outreach visits: effects on professional practice and health care outcomes
O'Brien, M. A., Rogers, S., Jamtvedt, G., Oxman, A. D., Odgaard-Jensen, J., Kristoffersen, D. T., Forsetlund, L., Bainbridge, D., Freemantle, N., Davis, D., et al. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000409.pub2 · Cited by 1,279
Local opinion leaders: effects on professional practice and health care outcomes
Flodgren, G., Parmelli, E., Doumit, G., Gattellari, M., O'Brien, M. A., Grimshaw, J., & Eccles, M. P. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000125.pub4 · Cited by 1,070
Self-citationBaker, R., Camosso-Stefinovic, J., Gillies, C., Shaw, E. J., Cheater, F., Flottorp, S., & Robertson, N. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005470.pub2 · Cited by 1,003
Individual determinants of research utilization by nurses: a systematic review update
Squires, J. E., Estabrooks, C. A., Gustavsson, P., & Wallin, L. (2011) · Implementation Science · doi:10.1186/1748-5908-6-1 · Cited by 798
Tailored interventions to address determinants of practice
Baker, R., Camosso-Stefinovic, J., Gillies, C., Shaw, E. J., Cheater, F., Flottorp, S., Robertson, N., Wensing, M., Fiander, M., Eccles, M. P., et al. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005470.pub3 · Cited by 711
Self-citationMass media interventions: effects on health services utilisation
Grilli, R., Ramsay, C., & Minozzi, S. (2002) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000389 · Cited by 533
Diffusion of Innovations in Health Service Organisations: A Systematic Literature Review
(2005) · doi:10.1002/9780470987407 · Cited by 439 · cited 2×
“The format used to communicate the content of a CPG can also influence its adoption (Greenhalgh 2005; Rogers 1995).”
MethodTailored Implementation for Chronic Diseases (TICD): a project protocol
Wensing, M., Oxman, A., Baker, R., Godycki-Cwirko, M., Flottorp, S., Szecsenyi, J., Grimshaw, J., & Eccles, M. (2011) · Implementation Science · doi:10.1186/1748-5908-6-103 · Cited by 184
Self-citationFlottorp, S., Oxman, A. D., Håvelsrud, K., Treweek, S., & Herrin, J. (2002) · BMJ · doi:10.1136/bmj.325.7360.367 · Cited by 154
Rational prescribing in primary care (RaPP): a cluster randomized trial of a tailored intervention
Fretheim, A., Oxman, A. D., Håvelsrud, K., Treweek, S., Kristoffersen, D. T., & Bjørndal, A. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030134 · Cited by 99
A pragmatic cluster randomised trial evaluating three implementation interventions
Rycroft-Malone, J., Seers, K., Crichton, N., Chandler, J., Hawkes, C. A., Allen, C., Bullock, I., & Strunin, L. (2012) · Implementation Science · doi:10.1186/1748-5908-7-80 · Cited by 71
Flottorp, S., & Oxman, A. D. (2003) · BMC Health Services Research · doi:10.1186/1472-6963-3-3 · Cited by 62
Hoeijenbos, M., Bekkering, T., Lamers, L., Hendriks, E., van Tulder, M., & Koopmanschap, M. (2005) · Health Policy · doi:10.1016/j.healthpol.2005.02.008 · Cited by 61
Robling, M. R., Houston, H. L. A., Kinnersley, P., Hourihan, M. D., Cohen, D. R., Hale, J., & Hood, K. (2002) · Clinical Radiology · doi:10.1053/crad.2001.0864 · Cited by 39
Cited by
Shlipak, M. G., Tummalapalli, S. L., Boulware, L. E., Grams, M. E., Ix, J. H., Jha, V., Kengne, A.-P., Madero, M., Mihaylova, B., Tangri, N., et al. (2021) · Kidney International · doi:10.1016/j.kint.2020.10.012 · Cited by 581
Murad, M. H. (2017) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2017.01.001 · Cited by 386
Pereira, V. C., Silva, S. N., Carvalho, V. K. S., Zanghelini, F., & Barreto, J. O. M. (2022) · Health Research Policy and Systems · doi:10.1186/s12961-022-00815-4 · Cited by 294
Samalin, L., Garnier, M., Auclair, C., & Llorca, P.-M. (2016) · International Journal of Molecular Sciences · doi:10.3390/ijms17111935 · Cited by 23
“Moreover, the implementation of educational regional workshops in France following their publication probably also helped to promote their use, as highlighted by a recent Cochrane systematic review [26].”
Metadata
- Authors
- Flodgren, G., Hall, A. M., Goulding, L., Eccles, M. P., Grimshaw, J. M., Leng, G. C., & Shepperd, S.
- Venue
- Cochrane Database of Systematic Reviews
- Publisher
- Wiley
- Published
- 2016-08-22
- Volume
- 2016
- Issue
- 8
- Pages
- CD010669-CD010669
- ISSN
- 1361-6137 (ISSN-L)
- 1465-1858
- OpenAlex
- W2167152158
- Cited by
- 159
- References
- 24
- FWCI
- 14.81
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.